Oct 14 13:20:05.134122 master-0 systemd[1]: Starting Kubernetes Kubelet... Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --register-with-taints has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --pod-infra-container-image has been deprecated, will be removed in a future release. Image garbage collector will get sandbox image information from CRI. Oct 14 13:20:05.878218 master-0 kubenswrapper[4807]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Oct 14 13:20:05.881884 master-0 kubenswrapper[4807]: I1014 13:20:05.881541 4807 server.go:211] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Oct 14 13:20:05.885672 master-0 kubenswrapper[4807]: W1014 13:20:05.885631 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Oct 14 13:20:05.885672 master-0 kubenswrapper[4807]: W1014 13:20:05.885658 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 14 13:20:05.885672 master-0 kubenswrapper[4807]: W1014 13:20:05.885668 4807 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Oct 14 13:20:05.885672 master-0 kubenswrapper[4807]: W1014 13:20:05.885676 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885685 4807 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885692 4807 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885699 4807 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885707 4807 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885714 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885721 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885728 4807 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885734 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885739 4807 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885745 4807 feature_gate.go:330] unrecognized feature gate: GatewayAPI Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885752 4807 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885758 4807 feature_gate.go:330] unrecognized feature gate: NewOLM Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885765 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885771 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885778 4807 feature_gate.go:330] unrecognized feature gate: PinnedImages Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885784 4807 feature_gate.go:330] unrecognized feature gate: SignatureStores Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885805 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885813 4807 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885822 4807 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 14 13:20:05.885811 master-0 kubenswrapper[4807]: W1014 13:20:05.885831 4807 feature_gate.go:330] unrecognized feature gate: Example Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885838 4807 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885846 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfig Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885853 4807 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885859 4807 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885865 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885871 4807 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885878 4807 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885885 4807 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885891 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885897 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885904 4807 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885910 4807 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885917 4807 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885923 4807 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885929 4807 feature_gate.go:330] unrecognized feature gate: PlatformOperators Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885935 4807 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885941 4807 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885947 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885953 4807 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Oct 14 13:20:05.886307 master-0 kubenswrapper[4807]: W1014 13:20:05.885959 4807 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885965 4807 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885971 4807 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885977 4807 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885983 4807 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885990 4807 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.885996 4807 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886002 4807 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886008 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886014 4807 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886022 4807 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886026 4807 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886031 4807 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886037 4807 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886053 4807 feature_gate.go:330] unrecognized feature gate: OVNObservability Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886058 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886063 4807 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886069 4807 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886075 4807 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Oct 14 13:20:05.886767 master-0 kubenswrapper[4807]: W1014 13:20:05.886080 4807 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886084 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886088 4807 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886093 4807 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886097 4807 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886102 4807 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886108 4807 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886112 4807 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886117 4807 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: W1014 13:20:05.886123 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886943 4807 flags.go:64] FLAG: --address="0.0.0.0" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886962 4807 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886973 4807 flags.go:64] FLAG: --anonymous-auth="true" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886980 4807 flags.go:64] FLAG: --application-metrics-count-limit="100" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886986 4807 flags.go:64] FLAG: --authentication-token-webhook="false" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886992 4807 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.886998 4807 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.887004 4807 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.887010 4807 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.887015 4807 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.887021 4807 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Oct 14 13:20:05.887146 master-0 kubenswrapper[4807]: I1014 13:20:05.887026 4807 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887032 4807 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887036 4807 flags.go:64] FLAG: --cgroup-root="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887041 4807 flags.go:64] FLAG: --cgroups-per-qos="true" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887047 4807 flags.go:64] FLAG: --client-ca-file="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887052 4807 flags.go:64] FLAG: --cloud-config="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887058 4807 flags.go:64] FLAG: --cloud-provider="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887064 4807 flags.go:64] FLAG: --cluster-dns="[]" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887071 4807 flags.go:64] FLAG: --cluster-domain="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887075 4807 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887081 4807 flags.go:64] FLAG: --config-dir="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887104 4807 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887110 4807 flags.go:64] FLAG: --container-log-max-files="5" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887120 4807 flags.go:64] FLAG: --container-log-max-size="10Mi" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887125 4807 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887131 4807 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887136 4807 flags.go:64] FLAG: --containerd-namespace="k8s.io" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887141 4807 flags.go:64] FLAG: --contention-profiling="false" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887146 4807 flags.go:64] FLAG: --cpu-cfs-quota="true" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887152 4807 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887158 4807 flags.go:64] FLAG: --cpu-manager-policy="none" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887163 4807 flags.go:64] FLAG: --cpu-manager-policy-options="" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887170 4807 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887175 4807 flags.go:64] FLAG: --enable-controller-attach-detach="true" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887180 4807 flags.go:64] FLAG: --enable-debugging-handlers="true" Oct 14 13:20:05.887587 master-0 kubenswrapper[4807]: I1014 13:20:05.887185 4807 flags.go:64] FLAG: --enable-load-reader="false" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887190 4807 flags.go:64] FLAG: --enable-server="true" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887195 4807 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887204 4807 flags.go:64] FLAG: --event-burst="100" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887210 4807 flags.go:64] FLAG: --event-qps="50" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887214 4807 flags.go:64] FLAG: --event-storage-age-limit="default=0" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887219 4807 flags.go:64] FLAG: --event-storage-event-limit="default=0" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887224 4807 flags.go:64] FLAG: --eviction-hard="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887231 4807 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887237 4807 flags.go:64] FLAG: --eviction-minimum-reclaim="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887242 4807 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887247 4807 flags.go:64] FLAG: --eviction-soft="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887252 4807 flags.go:64] FLAG: --eviction-soft-grace-period="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887257 4807 flags.go:64] FLAG: --exit-on-lock-contention="false" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887262 4807 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887267 4807 flags.go:64] FLAG: --experimental-mounter-path="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887272 4807 flags.go:64] FLAG: --fail-cgroupv1="false" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887277 4807 flags.go:64] FLAG: --fail-swap-on="true" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887282 4807 flags.go:64] FLAG: --feature-gates="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887289 4807 flags.go:64] FLAG: --file-check-frequency="20s" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887296 4807 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887302 4807 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887306 4807 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887312 4807 flags.go:64] FLAG: --healthz-port="10248" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887317 4807 flags.go:64] FLAG: --help="false" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887322 4807 flags.go:64] FLAG: --hostname-override="" Oct 14 13:20:05.888242 master-0 kubenswrapper[4807]: I1014 13:20:05.887327 4807 flags.go:64] FLAG: --housekeeping-interval="10s" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887332 4807 flags.go:64] FLAG: --http-check-frequency="20s" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887337 4807 flags.go:64] FLAG: --image-credential-provider-bin-dir="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887341 4807 flags.go:64] FLAG: --image-credential-provider-config="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887346 4807 flags.go:64] FLAG: --image-gc-high-threshold="85" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887350 4807 flags.go:64] FLAG: --image-gc-low-threshold="80" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887356 4807 flags.go:64] FLAG: --image-service-endpoint="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887360 4807 flags.go:64] FLAG: --kernel-memcg-notification="false" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887365 4807 flags.go:64] FLAG: --kube-api-burst="100" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887370 4807 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887375 4807 flags.go:64] FLAG: --kube-api-qps="50" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887380 4807 flags.go:64] FLAG: --kube-reserved="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887385 4807 flags.go:64] FLAG: --kube-reserved-cgroup="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887389 4807 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887394 4807 flags.go:64] FLAG: --kubelet-cgroups="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887399 4807 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887404 4807 flags.go:64] FLAG: --lock-file="" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887409 4807 flags.go:64] FLAG: --log-cadvisor-usage="false" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887414 4807 flags.go:64] FLAG: --log-flush-frequency="5s" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887419 4807 flags.go:64] FLAG: --log-json-info-buffer-size="0" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887426 4807 flags.go:64] FLAG: --log-json-split-stream="false" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887431 4807 flags.go:64] FLAG: --log-text-info-buffer-size="0" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887436 4807 flags.go:64] FLAG: --log-text-split-stream="false" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887441 4807 flags.go:64] FLAG: --logging-format="text" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887445 4807 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Oct 14 13:20:05.888892 master-0 kubenswrapper[4807]: I1014 13:20:05.887451 4807 flags.go:64] FLAG: --make-iptables-util-chains="true" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887471 4807 flags.go:64] FLAG: --manifest-url="" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887478 4807 flags.go:64] FLAG: --manifest-url-header="" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887485 4807 flags.go:64] FLAG: --max-housekeeping-interval="15s" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887490 4807 flags.go:64] FLAG: --max-open-files="1000000" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887497 4807 flags.go:64] FLAG: --max-pods="110" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887502 4807 flags.go:64] FLAG: --maximum-dead-containers="-1" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887507 4807 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887512 4807 flags.go:64] FLAG: --memory-manager-policy="None" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887517 4807 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887521 4807 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887526 4807 flags.go:64] FLAG: --node-ip="192.168.34.10" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887531 4807 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/control-plane=,node-role.kubernetes.io/master=,node.openshift.io/os_id=rhcos" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887546 4807 flags.go:64] FLAG: --node-status-max-images="50" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887550 4807 flags.go:64] FLAG: --node-status-update-frequency="10s" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887555 4807 flags.go:64] FLAG: --oom-score-adj="-999" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887560 4807 flags.go:64] FLAG: --pod-cidr="" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887565 4807 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:2d66b9dbe1d071d7372c477a78835fb65b48ea82db00d23e9086af5cfcb194ad" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887575 4807 flags.go:64] FLAG: --pod-manifest-path="" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887580 4807 flags.go:64] FLAG: --pod-max-pids="-1" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887585 4807 flags.go:64] FLAG: --pods-per-core="0" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887590 4807 flags.go:64] FLAG: --port="10250" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887596 4807 flags.go:64] FLAG: --protect-kernel-defaults="false" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887601 4807 flags.go:64] FLAG: --provider-id="" Oct 14 13:20:05.889393 master-0 kubenswrapper[4807]: I1014 13:20:05.887607 4807 flags.go:64] FLAG: --qos-reserved="" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887612 4807 flags.go:64] FLAG: --read-only-port="10255" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887617 4807 flags.go:64] FLAG: --register-node="true" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887623 4807 flags.go:64] FLAG: --register-schedulable="true" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887627 4807 flags.go:64] FLAG: --register-with-taints="node-role.kubernetes.io/master=:NoSchedule" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887636 4807 flags.go:64] FLAG: --registry-burst="10" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887640 4807 flags.go:64] FLAG: --registry-qps="5" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887645 4807 flags.go:64] FLAG: --reserved-cpus="" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887650 4807 flags.go:64] FLAG: --reserved-memory="" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887657 4807 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887663 4807 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887667 4807 flags.go:64] FLAG: --rotate-certificates="false" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887673 4807 flags.go:64] FLAG: --rotate-server-certificates="false" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887678 4807 flags.go:64] FLAG: --runonce="false" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887684 4807 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887690 4807 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887695 4807 flags.go:64] FLAG: --seccomp-default="false" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887700 4807 flags.go:64] FLAG: --serialize-image-pulls="true" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887705 4807 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887710 4807 flags.go:64] FLAG: --storage-driver-db="cadvisor" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887715 4807 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887720 4807 flags.go:64] FLAG: --storage-driver-password="root" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887725 4807 flags.go:64] FLAG: --storage-driver-secure="false" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887729 4807 flags.go:64] FLAG: --storage-driver-table="stats" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887735 4807 flags.go:64] FLAG: --storage-driver-user="root" Oct 14 13:20:05.889924 master-0 kubenswrapper[4807]: I1014 13:20:05.887740 4807 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887745 4807 flags.go:64] FLAG: --sync-frequency="1m0s" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887750 4807 flags.go:64] FLAG: --system-cgroups="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887755 4807 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887764 4807 flags.go:64] FLAG: --system-reserved-cgroup="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887769 4807 flags.go:64] FLAG: --tls-cert-file="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887774 4807 flags.go:64] FLAG: --tls-cipher-suites="[]" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887780 4807 flags.go:64] FLAG: --tls-min-version="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887785 4807 flags.go:64] FLAG: --tls-private-key-file="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887790 4807 flags.go:64] FLAG: --topology-manager-policy="none" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887795 4807 flags.go:64] FLAG: --topology-manager-policy-options="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887799 4807 flags.go:64] FLAG: --topology-manager-scope="container" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887804 4807 flags.go:64] FLAG: --v="2" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887812 4807 flags.go:64] FLAG: --version="false" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887818 4807 flags.go:64] FLAG: --vmodule="" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887824 4807 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: I1014 13:20:05.887832 4807 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887957 4807 feature_gate.go:330] unrecognized feature gate: GatewayAPI Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887964 4807 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887970 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887976 4807 feature_gate.go:330] unrecognized feature gate: OVNObservability Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887980 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887984 4807 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Oct 14 13:20:05.890480 master-0 kubenswrapper[4807]: W1014 13:20:05.887989 4807 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.887993 4807 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.887999 4807 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888004 4807 feature_gate.go:330] unrecognized feature gate: SignatureStores Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888008 4807 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888014 4807 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888019 4807 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888024 4807 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888028 4807 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888033 4807 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888037 4807 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888041 4807 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888045 4807 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888050 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888054 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888058 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888062 4807 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888066 4807 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888071 4807 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Oct 14 13:20:05.890964 master-0 kubenswrapper[4807]: W1014 13:20:05.888075 4807 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888079 4807 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888083 4807 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888088 4807 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888092 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888097 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888105 4807 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888109 4807 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888113 4807 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888118 4807 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888122 4807 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888127 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888131 4807 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888135 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888140 4807 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888144 4807 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888148 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888152 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888157 4807 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Oct 14 13:20:05.891372 master-0 kubenswrapper[4807]: W1014 13:20:05.888163 4807 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888168 4807 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888173 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888178 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888183 4807 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888187 4807 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888191 4807 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888196 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888200 4807 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888204 4807 feature_gate.go:330] unrecognized feature gate: Example Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888208 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfig Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888212 4807 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888216 4807 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888221 4807 feature_gate.go:330] unrecognized feature gate: NewOLM Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888225 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888229 4807 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888233 4807 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888237 4807 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888241 4807 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888249 4807 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Oct 14 13:20:05.891776 master-0 kubenswrapper[4807]: W1014 13:20:05.888254 4807 feature_gate.go:330] unrecognized feature gate: PinnedImages Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888259 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888264 4807 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888268 4807 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888273 4807 feature_gate.go:330] unrecognized feature gate: PlatformOperators Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888278 4807 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888282 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: W1014 13:20:05.888287 4807 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Oct 14 13:20:05.892174 master-0 kubenswrapper[4807]: I1014 13:20:05.888295 4807 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Oct 14 13:20:05.901273 master-0 kubenswrapper[4807]: I1014 13:20:05.901221 4807 server.go:491] "Kubelet version" kubeletVersion="v1.31.13" Oct 14 13:20:05.901273 master-0 kubenswrapper[4807]: I1014 13:20:05.901267 4807 server.go:493] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Oct 14 13:20:05.901339 master-0 kubenswrapper[4807]: W1014 13:20:05.901332 4807 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Oct 14 13:20:05.901363 master-0 kubenswrapper[4807]: W1014 13:20:05.901339 4807 feature_gate.go:330] unrecognized feature gate: SignatureStores Oct 14 13:20:05.901363 master-0 kubenswrapper[4807]: W1014 13:20:05.901346 4807 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Oct 14 13:20:05.901363 master-0 kubenswrapper[4807]: W1014 13:20:05.901352 4807 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 14 13:20:05.901363 master-0 kubenswrapper[4807]: W1014 13:20:05.901357 4807 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Oct 14 13:20:05.901363 master-0 kubenswrapper[4807]: W1014 13:20:05.901363 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901369 4807 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901375 4807 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901380 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901384 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901389 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901393 4807 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901397 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901401 4807 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901406 4807 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901411 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901415 4807 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901419 4807 feature_gate.go:330] unrecognized feature gate: GatewayAPI Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901424 4807 feature_gate.go:330] unrecognized feature gate: NewOLM Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901430 4807 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901435 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfig Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901440 4807 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901444 4807 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901449 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901454 4807 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Oct 14 13:20:05.901485 master-0 kubenswrapper[4807]: W1014 13:20:05.901474 4807 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901478 4807 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901483 4807 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901487 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901493 4807 feature_gate.go:330] unrecognized feature gate: PlatformOperators Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901499 4807 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901506 4807 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901512 4807 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901517 4807 feature_gate.go:330] unrecognized feature gate: OVNObservability Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901523 4807 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901528 4807 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901533 4807 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901537 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901542 4807 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901546 4807 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901570 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901575 4807 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901579 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901584 4807 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Oct 14 13:20:05.901894 master-0 kubenswrapper[4807]: W1014 13:20:05.901588 4807 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901594 4807 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901601 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901605 4807 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901610 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901615 4807 feature_gate.go:330] unrecognized feature gate: Example Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901620 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901625 4807 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901629 4807 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901634 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901638 4807 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901644 4807 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901650 4807 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901655 4807 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901660 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901666 4807 feature_gate.go:330] unrecognized feature gate: PinnedImages Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901671 4807 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901676 4807 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901680 4807 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Oct 14 13:20:05.902316 master-0 kubenswrapper[4807]: W1014 13:20:05.901684 4807 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901689 4807 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901693 4807 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901698 4807 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901702 4807 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901706 4807 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901710 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901717 4807 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901721 4807 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: I1014 13:20:05.901728 4807 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901861 4807 feature_gate.go:330] unrecognized feature gate: OVNObservability Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901871 4807 feature_gate.go:330] unrecognized feature gate: VolumeGroupSnapshot Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901877 4807 feature_gate.go:330] unrecognized feature gate: SetEIPForNLBIngressController Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901881 4807 feature_gate.go:330] unrecognized feature gate: MixedCPUsAllocation Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901887 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiNetworks Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901891 4807 feature_gate.go:330] unrecognized feature gate: NetworkLiveMigration Oct 14 13:20:05.902717 master-0 kubenswrapper[4807]: W1014 13:20:05.901897 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImages Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901901 4807 feature_gate.go:330] unrecognized feature gate: GCPLabelsTags Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901906 4807 feature_gate.go:330] unrecognized feature gate: AzureWorkloadIdentity Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901911 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfigAPI Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901917 4807 feature_gate.go:351] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901923 4807 feature_gate.go:330] unrecognized feature gate: AutomatedEtcdBackup Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901929 4807 feature_gate.go:353] Setting GA feature gate ValidatingAdmissionPolicy=true. It will be removed in a future release. Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901936 4807 feature_gate.go:330] unrecognized feature gate: OnClusterBuild Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901941 4807 feature_gate.go:330] unrecognized feature gate: VSphereDriverConfiguration Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901946 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAzure Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901951 4807 feature_gate.go:330] unrecognized feature gate: EtcdBackendQuota Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901955 4807 feature_gate.go:330] unrecognized feature gate: VSphereStaticIPs Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901960 4807 feature_gate.go:330] unrecognized feature gate: NetworkDiagnosticsConfig Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901965 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901969 4807 feature_gate.go:330] unrecognized feature gate: InsightsConfig Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901975 4807 feature_gate.go:353] Setting GA feature gate CloudDualStackNodeIPs=true. It will be removed in a future release. Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901980 4807 feature_gate.go:330] unrecognized feature gate: DNSNameResolver Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901986 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIProviderOpenStack Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901991 4807 feature_gate.go:330] unrecognized feature gate: MetricsCollectionProfiles Oct 14 13:20:05.903036 master-0 kubenswrapper[4807]: W1014 13:20:05.901997 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstall Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902002 4807 feature_gate.go:353] Setting GA feature gate DisableKubeletCloudCredentialProviders=true. It will be removed in a future release. Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902008 4807 feature_gate.go:330] unrecognized feature gate: OpenShiftPodSecurityAdmission Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902014 4807 feature_gate.go:330] unrecognized feature gate: ConsolePluginContentSecurityPolicy Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902019 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902024 4807 feature_gate.go:330] unrecognized feature gate: PinnedImages Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902030 4807 feature_gate.go:330] unrecognized feature gate: ClusterAPIInstallIBMCloud Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902035 4807 feature_gate.go:330] unrecognized feature gate: ExternalOIDC Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902040 4807 feature_gate.go:330] unrecognized feature gate: AWSEFSDriverVolumeMetrics Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902045 4807 feature_gate.go:330] unrecognized feature gate: GatewayAPI Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902050 4807 feature_gate.go:330] unrecognized feature gate: BareMetalLoadBalancer Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902054 4807 feature_gate.go:330] unrecognized feature gate: InsightsOnDemandDataGather Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902058 4807 feature_gate.go:330] unrecognized feature gate: AlibabaPlatform Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902063 4807 feature_gate.go:330] unrecognized feature gate: MachineConfigNodes Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902067 4807 feature_gate.go:330] unrecognized feature gate: GCPClusterHostedDNS Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902072 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerDynamicConfigurationManager Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902076 4807 feature_gate.go:330] unrecognized feature gate: UpgradeStatus Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902080 4807 feature_gate.go:330] unrecognized feature gate: PlatformOperators Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902084 4807 feature_gate.go:330] unrecognized feature gate: NutanixMultiSubnets Oct 14 13:20:05.903598 master-0 kubenswrapper[4807]: W1014 13:20:05.902088 4807 feature_gate.go:330] unrecognized feature gate: Example Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902093 4807 feature_gate.go:330] unrecognized feature gate: InsightsRuntimeExtractor Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902097 4807 feature_gate.go:330] unrecognized feature gate: MachineAPIMigration Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902102 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallGCP Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902106 4807 feature_gate.go:330] unrecognized feature gate: IngressControllerLBSubnetsAWS Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902110 4807 feature_gate.go:330] unrecognized feature gate: PrivateHostedZoneAWS Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902114 4807 feature_gate.go:330] unrecognized feature gate: ChunkSizeMiB Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902119 4807 feature_gate.go:330] unrecognized feature gate: HardwareSpeed Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902124 4807 feature_gate.go:330] unrecognized feature gate: NewOLM Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902128 4807 feature_gate.go:330] unrecognized feature gate: ClusterMonitoringConfig Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902132 4807 feature_gate.go:330] unrecognized feature gate: CSIDriverSharedResource Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902137 4807 feature_gate.go:330] unrecognized feature gate: BuildCSIVolumes Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902141 4807 feature_gate.go:330] unrecognized feature gate: VSphereControlPlaneMachineSet Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902146 4807 feature_gate.go:330] unrecognized feature gate: NetworkSegmentation Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902150 4807 feature_gate.go:330] unrecognized feature gate: NodeDisruptionPolicy Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902154 4807 feature_gate.go:330] unrecognized feature gate: AdditionalRoutingCapabilities Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902158 4807 feature_gate.go:330] unrecognized feature gate: SignatureStores Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902162 4807 feature_gate.go:330] unrecognized feature gate: PersistentIPsForVirtualization Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902166 4807 feature_gate.go:330] unrecognized feature gate: ImageStreamImportMode Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902171 4807 feature_gate.go:330] unrecognized feature gate: SigstoreImageVerification Oct 14 13:20:05.903972 master-0 kubenswrapper[4807]: W1014 13:20:05.902175 4807 feature_gate.go:330] unrecognized feature gate: MinimumKubeletVersion Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902180 4807 feature_gate.go:330] unrecognized feature gate: ManagedBootImagesAWS Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902184 4807 feature_gate.go:330] unrecognized feature gate: AdminNetworkPolicy Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902189 4807 feature_gate.go:330] unrecognized feature gate: AWSClusterHostedDNS Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902193 4807 feature_gate.go:330] unrecognized feature gate: MultiArchInstallAWS Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902200 4807 feature_gate.go:330] unrecognized feature gate: BootcNodeManagement Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902205 4807 feature_gate.go:330] unrecognized feature gate: VSphereMultiVCenters Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: W1014 13:20:05.902209 4807 feature_gate.go:330] unrecognized feature gate: RouteAdvertisements Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: I1014 13:20:05.902217 4807 feature_gate.go:386] feature gates: {map[CloudDualStackNodeIPs:true DisableKubeletCloudCredentialProviders:true DynamicResourceAllocation:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false NodeSwap:false ProcMountType:false RouteExternalCertificate:false ServiceAccountTokenNodeBinding:false TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:false UserNamespacesSupport:false ValidatingAdmissionPolicy:true VolumeAttributesClass:false]} Oct 14 13:20:05.904369 master-0 kubenswrapper[4807]: I1014 13:20:05.903600 4807 server.go:940] "Client rotation is on, will bootstrap in background" Oct 14 13:20:05.906336 master-0 kubenswrapper[4807]: I1014 13:20:05.906305 4807 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Oct 14 13:20:05.909438 master-0 kubenswrapper[4807]: I1014 13:20:05.909408 4807 server.go:997] "Starting client certificate rotation" Oct 14 13:20:05.909438 master-0 kubenswrapper[4807]: I1014 13:20:05.909432 4807 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate rotation is enabled Oct 14 13:20:05.911392 master-0 kubenswrapper[4807]: I1014 13:20:05.911329 4807 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Rotating certificates Oct 14 13:20:05.993652 master-0 kubenswrapper[4807]: I1014 13:20:05.993437 4807 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 14 13:20:06.005362 master-0 kubenswrapper[4807]: I1014 13:20:06.005256 4807 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Oct 14 13:20:06.036614 master-0 kubenswrapper[4807]: I1014 13:20:06.036490 4807 log.go:25] "Validated CRI v1 runtime API" Oct 14 13:20:06.051279 master-0 kubenswrapper[4807]: I1014 13:20:06.051207 4807 log.go:25] "Validated CRI v1 image API" Oct 14 13:20:06.053727 master-0 kubenswrapper[4807]: I1014 13:20:06.053657 4807 server.go:1437] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Oct 14 13:20:06.055984 master-0 kubenswrapper[4807]: I1014 13:20:06.055906 4807 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Oct 14 13:20:06.067424 master-0 kubenswrapper[4807]: I1014 13:20:06.067322 4807 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/vda2 910678ff-f77e-4a7d-8d53-86f2ac47a823:/dev/vda4 92615f3b-fee4-44bf-bc05-573fb1ad1b4d:/dev/vda3] Oct 14 13:20:06.067424 master-0 kubenswrapper[4807]: I1014 13:20:06.067400 4807 fs.go:136] Filesystem partitions: map[/dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /dev/vda3:{mountpoint:/boot major:252 minor:3 fsType:ext4 blockSize:0} /dev/vda4:{mountpoint:/var major:252 minor:4 fsType:xfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:30 fsType:tmpfs blockSize:0}] Oct 14 13:20:06.106858 master-0 kubenswrapper[4807]: I1014 13:20:06.106206 4807 manager.go:217] Machine: {Timestamp:2025-10-14 13:20:06.10295741 +0000 UTC m=+0.784259314 CPUVendorID:AuthenticAMD NumCores:16 NumPhysicalCores:1 NumSockets:16 CpuFrequency:2800000 MemoryCapacity:50514157568 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:f0c2b8f40fb445528dbcee567f949474 SystemUUID:f0c2b8f4-0fb4-4552-8dbc-ee567f949474 BootID:ff270eaf-4cd3-4eb8-9071-534f79598db0 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:30 Capacity:25257078784 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/vda3 DeviceMajor:252 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:25257078784 Type:vfs Inodes:6166279 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:10102833152 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/vda4 DeviceMajor:252 DeviceMinor:4 Capacity:214143315968 Type:vfs Inodes:104594880 HasInodes:true}] DiskMap:map[252:0:{Name:vda Major:252 Minor:0 Size:214748364800 Scheduler:none} 252:16:{Name:vdb Major:252 Minor:16 Size:21474836480 Scheduler:none} 252:32:{Name:vdc Major:252 Minor:32 Size:21474836480 Scheduler:none} 252:48:{Name:vdd Major:252 Minor:48 Size:21474836480 Scheduler:none} 252:64:{Name:vde Major:252 Minor:64 Size:21474836480 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:fa:16:3e:6a:26:b0 Speed:0 Mtu:9000} {Name:eth0 MacAddress:fa:16:3e:6a:26:b0 Speed:-1 Mtu:9000} {Name:eth1 MacAddress:fa:16:3e:6a:ea:08 Speed:-1 Mtu:9000} {Name:eth2 MacAddress:fa:16:3e:23:ef:57 Speed:-1 Mtu:9000} {Name:ovs-system MacAddress:9a:e7:35:27:b9:d5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:50514157568 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:0 Size:16777216 Type:Unified Level:3}] SocketID:0 BookID: DrawerID:} {Id:0 Threads:[1] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:1 Size:16777216 Type:Unified Level:3}] SocketID:1 BookID: DrawerID:} {Id:0 Threads:[10] Caches:[{Id:10 Size:32768 Type:Data Level:1} {Id:10 Size:32768 Type:Instruction Level:1} {Id:10 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:10 Size:16777216 Type:Unified Level:3}] SocketID:10 BookID: DrawerID:} {Id:0 Threads:[11] Caches:[{Id:11 Size:32768 Type:Data Level:1} {Id:11 Size:32768 Type:Instruction Level:1} {Id:11 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:11 Size:16777216 Type:Unified Level:3}] SocketID:11 BookID: DrawerID:} {Id:0 Threads:[12] Caches:[{Id:12 Size:32768 Type:Data Level:1} {Id:12 Size:32768 Type:Instruction Level:1} {Id:12 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:12 Size:16777216 Type:Unified Level:3}] SocketID:12 BookID: DrawerID:} {Id:0 Threads:[13] Caches:[{Id:13 Size:32768 Type:Data Level:1} {Id:13 Size:32768 Type:Instruction Level:1} {Id:13 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:13 Size:16777216 Type:Unified Level:3}] SocketID:13 BookID: DrawerID:} {Id:0 Threads:[14] Caches:[{Id:14 Size:32768 Type:Data Level:1} {Id:14 Size:32768 Type:Instruction Level:1} {Id:14 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:14 Size:16777216 Type:Unified Level:3}] SocketID:14 BookID: DrawerID:} {Id:0 Threads:[15] Caches:[{Id:15 Size:32768 Type:Data Level:1} {Id:15 Size:32768 Type:Instruction Level:1} {Id:15 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:15 Size:16777216 Type:Unified Level:3}] SocketID:15 BookID: DrawerID:} {Id:0 Threads:[2] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:2 Size:16777216 Type:Unified Level:3}] SocketID:2 BookID: DrawerID:} {Id:0 Threads:[3] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:3 Size:16777216 Type:Unified Level:3}] SocketID:3 BookID: DrawerID:} {Id:0 Threads:[4] Caches:[{Id:4 Size:32768 Type:Data Level:1} {Id:4 Size:32768 Type:Instruction Level:1} {Id:4 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:4 Size:16777216 Type:Unified Level:3}] SocketID:4 BookID: DrawerID:} {Id:0 Threads:[5] Caches:[{Id:5 Size:32768 Type:Data Level:1} {Id:5 Size:32768 Type:Instruction Level:1} {Id:5 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:5 Size:16777216 Type:Unified Level:3}] SocketID:5 BookID: DrawerID:} {Id:0 Threads:[6] Caches:[{Id:6 Size:32768 Type:Data Level:1} {Id:6 Size:32768 Type:Instruction Level:1} {Id:6 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:6 Size:16777216 Type:Unified Level:3}] SocketID:6 BookID: DrawerID:} {Id:0 Threads:[7] Caches:[{Id:7 Size:32768 Type:Data Level:1} {Id:7 Size:32768 Type:Instruction Level:1} {Id:7 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:7 Size:16777216 Type:Unified Level:3}] SocketID:7 BookID: DrawerID:} {Id:0 Threads:[8] Caches:[{Id:8 Size:32768 Type:Data Level:1} {Id:8 Size:32768 Type:Instruction Level:1} {Id:8 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:8 Size:16777216 Type:Unified Level:3}] SocketID:8 BookID: DrawerID:} {Id:0 Threads:[9] Caches:[{Id:9 Size:32768 Type:Data Level:1} {Id:9 Size:32768 Type:Instruction Level:1} {Id:9 Size:524288 Type:Unified Level:2}] UncoreCaches:[{Id:9 Size:16777216 Type:Unified Level:3}] SocketID:9 BookID: DrawerID:}] Caches:[] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Oct 14 13:20:06.106858 master-0 kubenswrapper[4807]: I1014 13:20:06.106737 4807 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Oct 14 13:20:06.107219 master-0 kubenswrapper[4807]: I1014 13:20:06.107089 4807 manager.go:233] Version: {KernelVersion:5.14.0-427.91.1.el9_4.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 418.94.202509241235-0 DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Oct 14 13:20:06.110416 master-0 kubenswrapper[4807]: I1014 13:20:06.109526 4807 swap_util.go:113] "Swap is on" /proc/swaps contents="Filename\t\t\t\tType\t\tSize\t\tUsed\t\tPriority" Oct 14 13:20:06.112165 master-0 kubenswrapper[4807]: I1014 13:20:06.112077 4807 container_manager_linux.go:267] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Oct 14 13:20:06.112521 master-0 kubenswrapper[4807]: I1014 13:20:06.112157 4807 container_manager_linux.go:272] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"master-0","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"ExperimentalMemoryManagerPolicy":"None","ExperimentalMemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Oct 14 13:20:06.112626 master-0 kubenswrapper[4807]: I1014 13:20:06.112567 4807 topology_manager.go:138] "Creating topology manager with none policy" Oct 14 13:20:06.112626 master-0 kubenswrapper[4807]: I1014 13:20:06.112589 4807 container_manager_linux.go:303] "Creating device plugin manager" Oct 14 13:20:06.112626 master-0 kubenswrapper[4807]: I1014 13:20:06.112616 4807 manager.go:142] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 14 13:20:06.112810 master-0 kubenswrapper[4807]: I1014 13:20:06.112649 4807 server.go:66] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Oct 14 13:20:06.113354 master-0 kubenswrapper[4807]: I1014 13:20:06.113302 4807 state_mem.go:36] "Initialized new in-memory state store" Oct 14 13:20:06.113551 master-0 kubenswrapper[4807]: I1014 13:20:06.113509 4807 server.go:1245] "Using root directory" path="/var/lib/kubelet" Oct 14 13:20:06.116366 master-0 kubenswrapper[4807]: I1014 13:20:06.116320 4807 kubelet.go:418] "Attempting to sync node with API server" Oct 14 13:20:06.116366 master-0 kubenswrapper[4807]: I1014 13:20:06.116365 4807 kubelet.go:313] "Adding static pod path" path="/etc/kubernetes/manifests" Oct 14 13:20:06.116546 master-0 kubenswrapper[4807]: I1014 13:20:06.116417 4807 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Oct 14 13:20:06.116546 master-0 kubenswrapper[4807]: I1014 13:20:06.116440 4807 kubelet.go:324] "Adding apiserver pod source" Oct 14 13:20:06.116546 master-0 kubenswrapper[4807]: I1014 13:20:06.116489 4807 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Oct 14 13:20:06.121269 master-0 kubenswrapper[4807]: I1014 13:20:06.121215 4807 kuberuntime_manager.go:262] "Container runtime initialized" containerRuntime="cri-o" version="1.31.12-3.rhaos4.18.gitdc59c78.el9" apiVersion="v1" Oct 14 13:20:06.123713 master-0 kubenswrapper[4807]: I1014 13:20:06.123652 4807 kubelet.go:854] "Not starting ClusterTrustBundle informer because we are in static kubelet mode" Oct 14 13:20:06.123942 master-0 kubenswrapper[4807]: I1014 13:20:06.123909 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Oct 14 13:20:06.123942 master-0 kubenswrapper[4807]: I1014 13:20:06.123932 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Oct 14 13:20:06.123942 master-0 kubenswrapper[4807]: I1014 13:20:06.123940 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Oct 14 13:20:06.123942 master-0 kubenswrapper[4807]: I1014 13:20:06.123948 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.123960 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.123968 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/secret" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.123975 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.123986 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.123994 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/fc" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.124001 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Oct 14 13:20:06.124168 master-0 kubenswrapper[4807]: I1014 13:20:06.124014 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/projected" Oct 14 13:20:06.124552 master-0 kubenswrapper[4807]: I1014 13:20:06.124518 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Oct 14 13:20:06.125519 master-0 kubenswrapper[4807]: I1014 13:20:06.125418 4807 plugins.go:603] "Loaded volume plugin" pluginName="kubernetes.io/csi" Oct 14 13:20:06.126144 master-0 kubenswrapper[4807]: I1014 13:20:06.126059 4807 server.go:1280] "Started kubelet" Oct 14 13:20:06.126372 master-0 kubenswrapper[4807]: I1014 13:20:06.126212 4807 server.go:163] "Starting to listen" address="0.0.0.0" port=10250 Oct 14 13:20:06.127097 master-0 kubenswrapper[4807]: I1014 13:20:06.126959 4807 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Oct 14 13:20:06.127362 master-0 kubenswrapper[4807]: I1014 13:20:06.127118 4807 server_v1.go:47] "podresources" method="list" useActivePods=true Oct 14 13:20:06.127868 master-0 systemd[1]: Started Kubernetes Kubelet. Oct 14 13:20:06.128795 master-0 kubenswrapper[4807]: I1014 13:20:06.128036 4807 server.go:236] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Oct 14 13:20:06.129375 master-0 kubenswrapper[4807]: I1014 13:20:06.129074 4807 server.go:449] "Adding debug handlers to kubelet server" Oct 14 13:20:06.129375 master-0 kubenswrapper[4807]: I1014 13:20:06.129252 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate rotation is enabled Oct 14 13:20:06.129375 master-0 kubenswrapper[4807]: I1014 13:20:06.129279 4807 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Oct 14 13:20:06.129621 master-0 kubenswrapper[4807]: I1014 13:20:06.129495 4807 volume_manager.go:287] "The desired_state_of_world populator starts" Oct 14 13:20:06.129621 master-0 kubenswrapper[4807]: I1014 13:20:06.129512 4807 volume_manager.go:289] "Starting Kubelet Volume Manager" Oct 14 13:20:06.129621 master-0 kubenswrapper[4807]: I1014 13:20:06.129618 4807 desired_state_of_world_populator.go:147] "Desired state populator starts to run" Oct 14 13:20:06.129877 master-0 kubenswrapper[4807]: E1014 13:20:06.129609 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:06.129877 master-0 kubenswrapper[4807]: I1014 13:20:06.129712 4807 reconstruct.go:97] "Volume reconstruction finished" Oct 14 13:20:06.129877 master-0 kubenswrapper[4807]: I1014 13:20:06.129723 4807 reconciler.go:26] "Reconciler: start to sync state" Oct 14 13:20:06.130883 master-0 kubenswrapper[4807]: W1014 13:20:06.130808 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Oct 14 13:20:06.131502 master-0 kubenswrapper[4807]: E1014 13:20:06.131025 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:06.131502 master-0 kubenswrapper[4807]: W1014 13:20:06.130794 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope Oct 14 13:20:06.131620 master-0 kubenswrapper[4807]: E1014 13:20:06.131570 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:06.140029 master-0 kubenswrapper[4807]: I1014 13:20:06.139952 4807 factory.go:55] Registering systemd factory Oct 14 13:20:06.140029 master-0 kubenswrapper[4807]: I1014 13:20:06.140018 4807 factory.go:221] Registration of the systemd container factory successfully Oct 14 13:20:06.140592 master-0 kubenswrapper[4807]: I1014 13:20:06.140549 4807 factory.go:153] Registering CRI-O factory Oct 14 13:20:06.140592 master-0 kubenswrapper[4807]: I1014 13:20:06.140581 4807 factory.go:221] Registration of the crio container factory successfully Oct 14 13:20:06.141645 master-0 kubenswrapper[4807]: I1014 13:20:06.140768 4807 factory.go:219] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Oct 14 13:20:06.141645 master-0 kubenswrapper[4807]: I1014 13:20:06.140818 4807 factory.go:103] Registering Raw factory Oct 14 13:20:06.141645 master-0 kubenswrapper[4807]: I1014 13:20:06.140841 4807 manager.go:1196] Started watching for new ooms in manager Oct 14 13:20:06.141645 master-0 kubenswrapper[4807]: I1014 13:20:06.141393 4807 manager.go:319] Starting recovery of all containers Oct 14 13:20:06.142012 master-0 kubenswrapper[4807]: E1014 13:20:06.141546 4807 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Oct 14 13:20:06.142255 master-0 kubenswrapper[4807]: I1014 13:20:06.142143 4807 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:06.142852 master-0 kubenswrapper[4807]: W1014 13:20:06.142799 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:06.142942 master-0 kubenswrapper[4807]: E1014 13:20:06.142894 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:06.144728 master-0 kubenswrapper[4807]: E1014 13:20:06.142951 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2262af8193 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.126010771 +0000 UTC m=+0.807312595,LastTimestamp:2025-10-14 13:20:06.126010771 +0000 UTC m=+0.807312595,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.146279 master-0 kubenswrapper[4807]: E1014 13:20:06.146235 4807 kubelet.go:1495] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Oct 14 13:20:06.172082 master-0 kubenswrapper[4807]: I1014 13:20:06.172030 4807 manager.go:324] Recovery completed Oct 14 13:20:06.191397 master-0 kubenswrapper[4807]: I1014 13:20:06.191325 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:06.194295 master-0 kubenswrapper[4807]: I1014 13:20:06.194245 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:06.194295 master-0 kubenswrapper[4807]: I1014 13:20:06.194298 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:06.194389 master-0 kubenswrapper[4807]: I1014 13:20:06.194323 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:06.195119 master-0 kubenswrapper[4807]: I1014 13:20:06.195084 4807 cpu_manager.go:225] "Starting CPU manager" policy="none" Oct 14 13:20:06.195119 master-0 kubenswrapper[4807]: I1014 13:20:06.195101 4807 cpu_manager.go:226] "Reconciling" reconcilePeriod="10s" Oct 14 13:20:06.195119 master-0 kubenswrapper[4807]: I1014 13:20:06.195120 4807 state_mem.go:36] "Initialized new in-memory state store" Oct 14 13:20:06.198058 master-0 kubenswrapper[4807]: I1014 13:20:06.198035 4807 policy_none.go:49] "None policy: Start" Oct 14 13:20:06.199565 master-0 kubenswrapper[4807]: I1014 13:20:06.199531 4807 memory_manager.go:170] "Starting memorymanager" policy="None" Oct 14 13:20:06.199625 master-0 kubenswrapper[4807]: I1014 13:20:06.199587 4807 state_mem.go:35] "Initializing new in-memory state store" Oct 14 13:20:06.204414 master-0 kubenswrapper[4807]: E1014 13:20:06.204270 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.215117 master-0 kubenswrapper[4807]: E1014 13:20:06.214965 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.223674 master-0 kubenswrapper[4807]: E1014 13:20:06.223545 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.229869 master-0 kubenswrapper[4807]: E1014 13:20:06.229827 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.258030 4807 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv4" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.260813 4807 kubelet_network_linux.go:50] "Initialized iptables rules." protocol="IPv6" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.260894 4807 status_manager.go:217] "Starting to sync pod status with apiserver" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.260930 4807 kubelet.go:2335] "Starting kubelet main sync loop" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: E1014 13:20:06.261142 4807 kubelet.go:2359] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.263367 4807 manager.go:334] "Starting Device Plugin manager" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.263507 4807 manager.go:513] "Failed to read data from checkpoint" checkpoint="kubelet_internal_checkpoint" err="checkpoint is not found" Oct 14 13:20:06.263949 master-0 kubenswrapper[4807]: I1014 13:20:06.263529 4807 server.go:79] "Starting device plugin registration server" Oct 14 13:20:06.264357 master-0 kubenswrapper[4807]: I1014 13:20:06.264267 4807 eviction_manager.go:189] "Eviction manager: starting control loop" Oct 14 13:20:06.264357 master-0 kubenswrapper[4807]: I1014 13:20:06.264290 4807 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Oct 14 13:20:06.264546 master-0 kubenswrapper[4807]: I1014 13:20:06.264516 4807 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Oct 14 13:20:06.264700 master-0 kubenswrapper[4807]: I1014 13:20:06.264662 4807 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Oct 14 13:20:06.264700 master-0 kubenswrapper[4807]: I1014 13:20:06.264687 4807 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Oct 14 13:20:06.266437 master-0 kubenswrapper[4807]: E1014 13:20:06.266399 4807 eviction_manager.go:285] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"master-0\" not found" Oct 14 13:20:06.272134 master-0 kubenswrapper[4807]: W1014 13:20:06.272106 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Oct 14 13:20:06.272247 master-0 kubenswrapper[4807]: E1014 13:20:06.272145 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:06.272727 master-0 kubenswrapper[4807]: E1014 13:20:06.272225 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e226b20ece8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.267661544 +0000 UTC m=+0.948963368,LastTimestamp:2025-10-14 13:20:06.267661544 +0000 UTC m=+0.948963368,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.345738 master-0 kubenswrapper[4807]: E1014 13:20:06.345611 4807 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Oct 14 13:20:06.361738 master-0 kubenswrapper[4807]: I1014 13:20:06.361603 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0"] Oct 14 13:20:06.361885 master-0 kubenswrapper[4807]: I1014 13:20:06.361853 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:06.363953 master-0 kubenswrapper[4807]: I1014 13:20:06.363886 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:06.363953 master-0 kubenswrapper[4807]: I1014 13:20:06.363954 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:06.364109 master-0 kubenswrapper[4807]: I1014 13:20:06.363968 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:06.364331 master-0 kubenswrapper[4807]: I1014 13:20:06.364294 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.364398 master-0 kubenswrapper[4807]: I1014 13:20:06.364336 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:06.365487 master-0 kubenswrapper[4807]: I1014 13:20:06.365394 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:06.365683 master-0 kubenswrapper[4807]: I1014 13:20:06.365623 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:06.365683 master-0 kubenswrapper[4807]: I1014 13:20:06.365680 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:06.365879 master-0 kubenswrapper[4807]: I1014 13:20:06.365711 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:06.366874 master-0 kubenswrapper[4807]: I1014 13:20:06.366833 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:06.366874 master-0 kubenswrapper[4807]: I1014 13:20:06.366876 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:06.367019 master-0 kubenswrapper[4807]: I1014 13:20:06.366889 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:06.367019 master-0 kubenswrapper[4807]: I1014 13:20:06.366914 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:06.377077 master-0 kubenswrapper[4807]: E1014 13:20:06.376088 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:06.363936053 +0000 UTC m=+1.045237877,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.388131 master-0 kubenswrapper[4807]: E1014 13:20:06.388042 4807 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Oct 14 13:20:06.388500 master-0 kubenswrapper[4807]: E1014 13:20:06.388141 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:06.363963614 +0000 UTC m=+1.045265438,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.399123 master-0 kubenswrapper[4807]: E1014 13:20:06.399002 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:06.363975505 +0000 UTC m=+1.045277329,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.406779 master-0 kubenswrapper[4807]: E1014 13:20:06.406646 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:06.365659691 +0000 UTC m=+1.046961525,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.416907 master-0 kubenswrapper[4807]: E1014 13:20:06.416778 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:06.365688652 +0000 UTC m=+1.046990486,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.424449 master-0 kubenswrapper[4807]: E1014 13:20:06.424323 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:06.365719223 +0000 UTC m=+1.047021057,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.433016 master-0 kubenswrapper[4807]: E1014 13:20:06.432890 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:06.366856475 +0000 UTC m=+1.048158309,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.441059 master-0 kubenswrapper[4807]: E1014 13:20:06.440930 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:06.366884446 +0000 UTC m=+1.048186280,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.450198 master-0 kubenswrapper[4807]: E1014 13:20:06.450067 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:06.366896867 +0000 UTC m=+1.048198701,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.530934 master-0 kubenswrapper[4807]: I1014 13:20:06.530762 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.530934 master-0 kubenswrapper[4807]: I1014 13:20:06.530846 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.589071 master-0 kubenswrapper[4807]: I1014 13:20:06.588892 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:06.591240 master-0 kubenswrapper[4807]: I1014 13:20:06.591106 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:06.591407 master-0 kubenswrapper[4807]: I1014 13:20:06.591320 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:06.591505 master-0 kubenswrapper[4807]: I1014 13:20:06.591419 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:06.591689 master-0 kubenswrapper[4807]: I1014 13:20:06.591643 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:06.603675 master-0 kubenswrapper[4807]: E1014 13:20:06.603600 4807 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Oct 14 13:20:06.604531 master-0 kubenswrapper[4807]: E1014 13:20:06.604309 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:06.591276731 +0000 UTC m=+1.272578625,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.616040 master-0 kubenswrapper[4807]: E1014 13:20:06.615728 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:06.591401249 +0000 UTC m=+1.272703113,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.625857 master-0 kubenswrapper[4807]: E1014 13:20:06.625689 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:06.591518907 +0000 UTC m=+1.272820781,Count:5,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:06.631194 master-0 kubenswrapper[4807]: I1014 13:20:06.631071 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.631194 master-0 kubenswrapper[4807]: I1014 13:20:06.631135 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.631338 master-0 kubenswrapper[4807]: I1014 13:20:06.631279 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-etc-kube\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.631385 master-0 kubenswrapper[4807]: I1014 13:20:06.631310 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/117b8efe269c98124cf5022ab3c340a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-master-0\" (UID: \"117b8efe269c98124cf5022ab3c340a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.698363 master-0 kubenswrapper[4807]: I1014 13:20:06.698277 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" Oct 14 13:20:06.757146 master-0 kubenswrapper[4807]: E1014 13:20:06.757067 4807 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="800ms" Oct 14 13:20:07.004625 master-0 kubenswrapper[4807]: I1014 13:20:07.004393 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:07.006106 master-0 kubenswrapper[4807]: I1014 13:20:07.006032 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:07.006106 master-0 kubenswrapper[4807]: I1014 13:20:07.006106 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:07.006311 master-0 kubenswrapper[4807]: I1014 13:20:07.006132 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:07.006311 master-0 kubenswrapper[4807]: I1014 13:20:07.006181 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:07.017000 master-0 kubenswrapper[4807]: E1014 13:20:07.016909 4807 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Oct 14 13:20:07.017000 master-0 kubenswrapper[4807]: W1014 13:20:07.016975 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope Oct 14 13:20:07.017541 master-0 kubenswrapper[4807]: E1014 13:20:07.017036 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:07.017541 master-0 kubenswrapper[4807]: E1014 13:20:07.017028 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:07.006086596 +0000 UTC m=+1.687388470,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.028888 master-0 kubenswrapper[4807]: E1014 13:20:07.028649 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:07.006123199 +0000 UTC m=+1.687425063,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.037598 master-0 kubenswrapper[4807]: E1014 13:20:07.037436 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:07.00614562 +0000 UTC m=+1.687447484,Count:6,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.152736 master-0 kubenswrapper[4807]: I1014 13:20:07.152646 4807 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:07.566739 master-0 kubenswrapper[4807]: E1014 13:20:07.566613 4807 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="1.6s" Oct 14 13:20:07.589577 master-0 kubenswrapper[4807]: W1014 13:20:07.589430 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod117b8efe269c98124cf5022ab3c340a5.slice/crio-95cee345f412142aa827a6d2966380ddf24b4fff101dbdf53592fb9c47443184 WatchSource:0}: Error finding container 95cee345f412142aa827a6d2966380ddf24b4fff101dbdf53592fb9c47443184: Status 404 returned error can't find the container with id 95cee345f412142aa827a6d2966380ddf24b4fff101dbdf53592fb9c47443184 Oct 14 13:20:07.593579 master-0 kubenswrapper[4807]: W1014 13:20:07.593536 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Node: nodes "master-0" is forbidden: User "system:anonymous" cannot list resource "nodes" in API group "" at the cluster scope Oct 14 13:20:07.593730 master-0 kubenswrapper[4807]: E1014 13:20:07.593596 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Node: failed to list *v1.Node: nodes \"master-0\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:07.599252 master-0 kubenswrapper[4807]: I1014 13:20:07.599172 4807 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 14 13:20:07.607806 master-0 kubenswrapper[4807]: E1014 13:20:07.607615 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.186e5e22ba7c58a2 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:117b8efe269c98124cf5022ab3c340a5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulling,Message:Pulling image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f22b65e5c744a32d3955dd7c36d809e3114a8aa501b44c00330dfda886c21169\",Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:07.599052962 +0000 UTC m=+2.280354816,LastTimestamp:2025-10-14 13:20:07.599052962 +0000 UTC m=+2.280354816,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.719818 master-0 kubenswrapper[4807]: W1014 13:20:07.719683 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:07.719818 master-0 kubenswrapper[4807]: E1014 13:20:07.719795 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:07.817416 master-0 kubenswrapper[4807]: I1014 13:20:07.817088 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:07.819692 master-0 kubenswrapper[4807]: I1014 13:20:07.819501 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:07.819692 master-0 kubenswrapper[4807]: I1014 13:20:07.819589 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:07.819692 master-0 kubenswrapper[4807]: I1014 13:20:07.819607 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:07.819692 master-0 kubenswrapper[4807]: I1014 13:20:07.819662 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:07.827875 master-0 kubenswrapper[4807]: W1014 13:20:07.827801 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Oct 14 13:20:07.828027 master-0 kubenswrapper[4807]: E1014 13:20:07.827875 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:07.828104 master-0 kubenswrapper[4807]: E1014 13:20:07.827929 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:07.819563974 +0000 UTC m=+2.500865828,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.828799 master-0 kubenswrapper[4807]: E1014 13:20:07.828739 4807 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Oct 14 13:20:07.830402 master-0 kubenswrapper[4807]: E1014 13:20:07.830240 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:07.819601076 +0000 UTC m=+2.500902940,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:07.840840 master-0 kubenswrapper[4807]: E1014 13:20:07.840661 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c209df\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c209df default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node master-0 status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194334175 +0000 UTC m=+0.875636009,LastTimestamp:2025-10-14 13:20:07.819618237 +0000 UTC m=+2.500920101,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:08.152024 master-0 kubenswrapper[4807]: I1014 13:20:08.151919 4807 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:08.267911 master-0 kubenswrapper[4807]: I1014 13:20:08.267737 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerStarted","Data":"95cee345f412142aa827a6d2966380ddf24b4fff101dbdf53592fb9c47443184"} Oct 14 13:20:09.127909 master-0 kubenswrapper[4807]: W1014 13:20:09.127840 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.Service: services is forbidden: User "system:anonymous" cannot list resource "services" in API group "" at the cluster scope Oct 14 13:20:09.127909 master-0 kubenswrapper[4807]: E1014 13:20:09.127915 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.Service: failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:09.149942 master-0 kubenswrapper[4807]: I1014 13:20:09.149908 4807 csi_plugin.go:884] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "master-0" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:09.175547 master-0 kubenswrapper[4807]: E1014 13:20:09.175427 4807 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"master-0\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="3.2s" Oct 14 13:20:09.239047 master-0 kubenswrapper[4807]: E1014 13:20:09.238886 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.186e5e231bca0e53 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:117b8efe269c98124cf5022ab3c340a5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Pulled,Message:Successfully pulled image \"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f22b65e5c744a32d3955dd7c36d809e3114a8aa501b44c00330dfda886c21169\" in 1.632s (1.632s including waiting). Image size: 458126368 bytes.,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:09.231535699 +0000 UTC m=+3.912837533,LastTimestamp:2025-10-14 13:20:09.231535699 +0000 UTC m=+3.912837533,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:09.430023 master-0 kubenswrapper[4807]: I1014 13:20:09.429952 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:09.431327 master-0 kubenswrapper[4807]: I1014 13:20:09.431283 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:09.431410 master-0 kubenswrapper[4807]: I1014 13:20:09.431332 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:09.431410 master-0 kubenswrapper[4807]: I1014 13:20:09.431350 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:09.431410 master-0 kubenswrapper[4807]: I1014 13:20:09.431389 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:09.439090 master-0 kubenswrapper[4807]: E1014 13:20:09.438907 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c14b20\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c14b20 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node master-0 status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194285344 +0000 UTC m=+0.875587188,LastTimestamp:2025-10-14 13:20:09.431314026 +0000 UTC m=+4.112615870,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:09.439431 master-0 kubenswrapper[4807]: E1014 13:20:09.439380 4807 kubelet_node_status.go:99] "Unable to register node with API server" err="nodes is forbidden: User \"system:anonymous\" cannot create resource \"nodes\" in API group \"\" at the cluster scope" node="master-0" Oct 14 13:20:09.445869 master-0 kubenswrapper[4807]: E1014 13:20:09.445742 4807 event.go:359] "Server rejected event (will not retry!)" err="events \"master-0.186e5e2266c1ab7f\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{master-0.186e5e2266c1ab7f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:master-0,UID:master-0,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node master-0 status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:06.194310015 +0000 UTC m=+0.875611849,LastTimestamp:2025-10-14 13:20:09.431342946 +0000 UTC m=+4.112644790,Count:8,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:09.500114 master-0 kubenswrapper[4807]: E1014 13:20:09.499665 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.186e5e232b21fce1 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:117b8efe269c98124cf5022ab3c340a5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Created,Message:Created container: setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:09.488956641 +0000 UTC m=+4.170258525,LastTimestamp:2025-10-14 13:20:09.488956641 +0000 UTC m=+4.170258525,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:09.515746 master-0 kubenswrapper[4807]: W1014 13:20:09.515678 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User "system:anonymous" cannot list resource "csidrivers" in API group "storage.k8s.io" at the cluster scope Oct 14 13:20:09.515814 master-0 kubenswrapper[4807]: E1014 13:20:09.515749 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.CSIDriver: failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:09.516294 master-0 kubenswrapper[4807]: E1014 13:20:09.516084 4807 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"openshift-machine-config-operator\"" event="&Event{ObjectMeta:{kube-rbac-proxy-crio-master-0.186e5e232c480e56 openshift-machine-config-operator 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Pod,Namespace:openshift-machine-config-operator,Name:kube-rbac-proxy-crio-master-0,UID:117b8efe269c98124cf5022ab3c340a5,APIVersion:v1,ResourceVersion:,FieldPath:spec.initContainers{setup},},Reason:Started,Message:Started container setup,Source:EventSource{Component:kubelet,Host:master-0,},FirstTimestamp:2025-10-14 13:20:09.508228694 +0000 UTC m=+4.189530548,LastTimestamp:2025-10-14 13:20:09.508228694 +0000 UTC m=+4.189530548,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:master-0,}" Oct 14 13:20:10.065876 master-0 kubenswrapper[4807]: W1014 13:20:10.065777 4807 reflector.go:561] k8s.io/client-go/informers/factory.go:160: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User "system:anonymous" cannot list resource "runtimeclasses" in API group "node.k8s.io" at the cluster scope Oct 14 13:20:10.065876 master-0 kubenswrapper[4807]: E1014 13:20:10.065851 4807 reflector.go:158] "Unhandled Error" err="k8s.io/client-go/informers/factory.go:160: Failed to watch *v1.RuntimeClass: failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" Oct 14 13:20:10.074855 master-0 kubenswrapper[4807]: I1014 13:20:10.074763 4807 csr.go:261] certificate signing request csr-2xkjb is approved, waiting to be issued Oct 14 13:20:10.092403 master-0 kubenswrapper[4807]: I1014 13:20:10.092317 4807 csr.go:257] certificate signing request csr-2xkjb is issued Oct 14 13:20:10.163380 master-0 kubenswrapper[4807]: I1014 13:20:10.163284 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.172446 master-0 kubenswrapper[4807]: I1014 13:20:10.172373 4807 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Oct 14 13:20:10.182407 master-0 kubenswrapper[4807]: I1014 13:20:10.182327 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.246531 master-0 kubenswrapper[4807]: I1014 13:20:10.246424 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.275775 master-0 kubenswrapper[4807]: I1014 13:20:10.275679 4807 generic.go:334] "Generic (PLEG): container finished" podID="117b8efe269c98124cf5022ab3c340a5" containerID="04e0158a7109a826fe54c8bfe5e951a6b8afda701afb3d6a04285880a718f99e" exitCode=0 Oct 14 13:20:10.275925 master-0 kubenswrapper[4807]: I1014 13:20:10.275809 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:10.276013 master-0 kubenswrapper[4807]: I1014 13:20:10.275785 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerDied","Data":"04e0158a7109a826fe54c8bfe5e951a6b8afda701afb3d6a04285880a718f99e"} Oct 14 13:20:10.277236 master-0 kubenswrapper[4807]: I1014 13:20:10.277150 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:10.277343 master-0 kubenswrapper[4807]: I1014 13:20:10.277245 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:10.277343 master-0 kubenswrapper[4807]: I1014 13:20:10.277268 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:10.527328 master-0 kubenswrapper[4807]: I1014 13:20:10.527267 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.527328 master-0 kubenswrapper[4807]: E1014 13:20:10.527322 4807 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Oct 14 13:20:10.552983 master-0 kubenswrapper[4807]: I1014 13:20:10.552942 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.579276 master-0 kubenswrapper[4807]: I1014 13:20:10.579220 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.641583 master-0 kubenswrapper[4807]: I1014 13:20:10.641501 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.908851 master-0 kubenswrapper[4807]: I1014 13:20:10.908701 4807 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Oct 14 13:20:10.909384 master-0 kubenswrapper[4807]: W1014 13:20:10.909083 4807 reflector.go:484] k8s.io/client-go/informers/factory.go:160: watch of *v1.Node ended with: very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received Oct 14 13:20:10.929292 master-0 kubenswrapper[4807]: I1014 13:20:10.929211 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:10.929292 master-0 kubenswrapper[4807]: E1014 13:20:10.929261 4807 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Oct 14 13:20:11.036008 master-0 kubenswrapper[4807]: I1014 13:20:11.035899 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:11.057095 master-0 kubenswrapper[4807]: I1014 13:20:11.057002 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:11.094936 master-0 kubenswrapper[4807]: I1014 13:20:11.094764 4807 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Certificate expiration is 2025-10-15 13:01:17 +0000 UTC, rotation deadline is 2025-10-15 06:05:47.211836911 +0000 UTC Oct 14 13:20:11.094936 master-0 kubenswrapper[4807]: I1014 13:20:11.094865 4807 certificate_manager.go:356] kubernetes.io/kube-apiserver-client-kubelet: Waiting 16h45m36.116978161s for next certificate rotation Oct 14 13:20:11.120139 master-0 kubenswrapper[4807]: I1014 13:20:11.119971 4807 apiserver.go:52] "Watching apiserver" Oct 14 13:20:11.121917 master-0 kubenswrapper[4807]: I1014 13:20:11.121855 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:11.122683 master-0 kubenswrapper[4807]: I1014 13:20:11.122623 4807 reflector.go:368] Caches populated for *v1.Pod from pkg/kubelet/config/apiserver.go:66 Oct 14 13:20:11.123382 master-0 kubenswrapper[4807]: I1014 13:20:11.123211 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=[] Oct 14 13:20:11.130169 master-0 kubenswrapper[4807]: I1014 13:20:11.130110 4807 desired_state_of_world_populator.go:155] "Finished populating initial desired state of world" Oct 14 13:20:11.280610 master-0 kubenswrapper[4807]: I1014 13:20:11.280343 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/0.log" Oct 14 13:20:11.281348 master-0 kubenswrapper[4807]: I1014 13:20:11.281070 4807 generic.go:334] "Generic (PLEG): container finished" podID="117b8efe269c98124cf5022ab3c340a5" containerID="13c98e3daca1d190d6cbd0151f1902920104dd913ee527089d6f2646fd869be9" exitCode=1 Oct 14 13:20:11.281348 master-0 kubenswrapper[4807]: I1014 13:20:11.281134 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerDied","Data":"13c98e3daca1d190d6cbd0151f1902920104dd913ee527089d6f2646fd869be9"} Oct 14 13:20:11.281348 master-0 kubenswrapper[4807]: I1014 13:20:11.281210 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:11.282338 master-0 kubenswrapper[4807]: I1014 13:20:11.282281 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:11.282425 master-0 kubenswrapper[4807]: I1014 13:20:11.282341 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:11.282425 master-0 kubenswrapper[4807]: I1014 13:20:11.282362 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:11.297331 master-0 kubenswrapper[4807]: I1014 13:20:11.297225 4807 scope.go:117] "RemoveContainer" containerID="13c98e3daca1d190d6cbd0151f1902920104dd913ee527089d6f2646fd869be9" Oct 14 13:20:11.397297 master-0 kubenswrapper[4807]: I1014 13:20:11.397232 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:11.397297 master-0 kubenswrapper[4807]: E1014 13:20:11.397283 4807 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Oct 14 13:20:11.951294 master-0 kubenswrapper[4807]: I1014 13:20:11.951164 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:11.970840 master-0 kubenswrapper[4807]: I1014 13:20:11.970703 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:12.036957 master-0 kubenswrapper[4807]: I1014 13:20:12.036833 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:12.285278 master-0 kubenswrapper[4807]: I1014 13:20:12.285034 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/1.log" Oct 14 13:20:12.286418 master-0 kubenswrapper[4807]: I1014 13:20:12.285601 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/0.log" Oct 14 13:20:12.286418 master-0 kubenswrapper[4807]: I1014 13:20:12.286125 4807 generic.go:334] "Generic (PLEG): container finished" podID="117b8efe269c98124cf5022ab3c340a5" containerID="580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb" exitCode=1 Oct 14 13:20:12.286418 master-0 kubenswrapper[4807]: I1014 13:20:12.286228 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerDied","Data":"580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb"} Oct 14 13:20:12.286418 master-0 kubenswrapper[4807]: I1014 13:20:12.286264 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:12.286418 master-0 kubenswrapper[4807]: I1014 13:20:12.286306 4807 scope.go:117] "RemoveContainer" containerID="13c98e3daca1d190d6cbd0151f1902920104dd913ee527089d6f2646fd869be9" Oct 14 13:20:12.287819 master-0 kubenswrapper[4807]: I1014 13:20:12.287763 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:12.287819 master-0 kubenswrapper[4807]: I1014 13:20:12.287793 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:12.287819 master-0 kubenswrapper[4807]: I1014 13:20:12.287803 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:12.306059 master-0 kubenswrapper[4807]: I1014 13:20:12.306020 4807 scope.go:117] "RemoveContainer" containerID="580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb" Oct 14 13:20:12.306563 master-0 kubenswrapper[4807]: E1014 13:20:12.306531 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(117b8efe269c98124cf5022ab3c340a5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="117b8efe269c98124cf5022ab3c340a5" Oct 14 13:20:12.315703 master-0 kubenswrapper[4807]: I1014 13:20:12.315374 4807 nodeinfomanager.go:401] Failed to publish CSINode: nodes "master-0" not found Oct 14 13:20:12.315703 master-0 kubenswrapper[4807]: E1014 13:20:12.315420 4807 csi_plugin.go:305] Failed to initialize CSINode: error updating CSINode annotation: timed out waiting for the condition; caused by: nodes "master-0" not found Oct 14 13:20:12.386725 master-0 kubenswrapper[4807]: E1014 13:20:12.386534 4807 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"master-0\" not found" node="master-0" Oct 14 13:20:12.640370 master-0 kubenswrapper[4807]: I1014 13:20:12.640177 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:12.642418 master-0 kubenswrapper[4807]: I1014 13:20:12.642325 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:12.642418 master-0 kubenswrapper[4807]: I1014 13:20:12.642497 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:12.642666 master-0 kubenswrapper[4807]: I1014 13:20:12.642521 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:12.642666 master-0 kubenswrapper[4807]: I1014 13:20:12.642583 4807 kubelet_node_status.go:76] "Attempting to register node" node="master-0" Oct 14 13:20:12.702176 master-0 kubenswrapper[4807]: I1014 13:20:12.702039 4807 kubelet_node_status.go:79] "Successfully registered node" node="master-0" Oct 14 13:20:12.702176 master-0 kubenswrapper[4807]: E1014 13:20:12.702108 4807 kubelet_node_status.go:585] "Error updating node status, will retry" err="error getting node \"master-0\": node \"master-0\" not found" Oct 14 13:20:12.759040 master-0 kubenswrapper[4807]: E1014 13:20:12.758923 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:12.859405 master-0 kubenswrapper[4807]: E1014 13:20:12.859155 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:12.959861 master-0 kubenswrapper[4807]: E1014 13:20:12.959562 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.060790 master-0 kubenswrapper[4807]: E1014 13:20:13.060614 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.135238 master-0 kubenswrapper[4807]: I1014 13:20:13.135093 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Rotating certificates Oct 14 13:20:13.149240 master-0 kubenswrapper[4807]: I1014 13:20:13.149157 4807 reflector.go:368] Caches populated for *v1.CertificateSigningRequest from k8s.io/client-go/tools/watch/informerwatcher.go:146 Oct 14 13:20:13.161258 master-0 kubenswrapper[4807]: E1014 13:20:13.161174 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.168295 master-0 kubenswrapper[4807]: I1014 13:20:13.168198 4807 ???:1] "http: TLS handshake error from 192.168.34.11:35186: no serving certificate available for the kubelet" Oct 14 13:20:13.262375 master-0 kubenswrapper[4807]: E1014 13:20:13.262011 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.271067 master-0 kubenswrapper[4807]: I1014 13:20:13.270971 4807 ???:1] "http: TLS handshake error from 192.168.34.11:35202: no serving certificate available for the kubelet" Oct 14 13:20:13.291701 master-0 kubenswrapper[4807]: I1014 13:20:13.291630 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/1.log" Oct 14 13:20:13.292533 master-0 kubenswrapper[4807]: I1014 13:20:13.292493 4807 kubelet_node_status.go:401] "Setting node annotation to enable volume controller attach/detach" Oct 14 13:20:13.293514 master-0 kubenswrapper[4807]: I1014 13:20:13.293445 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientMemory" Oct 14 13:20:13.293590 master-0 kubenswrapper[4807]: I1014 13:20:13.293560 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasNoDiskPressure" Oct 14 13:20:13.293590 master-0 kubenswrapper[4807]: I1014 13:20:13.293580 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeHasSufficientPID" Oct 14 13:20:13.294107 master-0 kubenswrapper[4807]: I1014 13:20:13.294071 4807 scope.go:117] "RemoveContainer" containerID="580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb" Oct 14 13:20:13.294338 master-0 kubenswrapper[4807]: E1014 13:20:13.294297 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 10s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(117b8efe269c98124cf5022ab3c340a5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="117b8efe269c98124cf5022ab3c340a5" Oct 14 13:20:13.362809 master-0 kubenswrapper[4807]: E1014 13:20:13.362678 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.371542 master-0 kubenswrapper[4807]: I1014 13:20:13.371498 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37270: no serving certificate available for the kubelet" Oct 14 13:20:13.463844 master-0 kubenswrapper[4807]: E1014 13:20:13.463680 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.471767 master-0 kubenswrapper[4807]: I1014 13:20:13.471682 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37272: no serving certificate available for the kubelet" Oct 14 13:20:13.564631 master-0 kubenswrapper[4807]: E1014 13:20:13.564340 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.576013 master-0 kubenswrapper[4807]: I1014 13:20:13.575933 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37280: no serving certificate available for the kubelet" Oct 14 13:20:13.664898 master-0 kubenswrapper[4807]: E1014 13:20:13.664761 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.705443 master-0 kubenswrapper[4807]: I1014 13:20:13.705360 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37282: no serving certificate available for the kubelet" Oct 14 13:20:13.765881 master-0 kubenswrapper[4807]: E1014 13:20:13.765767 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.867025 master-0 kubenswrapper[4807]: E1014 13:20:13.866907 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:13.901731 master-0 kubenswrapper[4807]: I1014 13:20:13.901642 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37288: no serving certificate available for the kubelet" Oct 14 13:20:13.967348 master-0 kubenswrapper[4807]: E1014 13:20:13.967160 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.068122 master-0 kubenswrapper[4807]: E1014 13:20:14.067786 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.169267 master-0 kubenswrapper[4807]: E1014 13:20:14.168936 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.263672 master-0 kubenswrapper[4807]: I1014 13:20:14.263599 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37302: no serving certificate available for the kubelet" Oct 14 13:20:14.269984 master-0 kubenswrapper[4807]: E1014 13:20:14.269905 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.370522 master-0 kubenswrapper[4807]: E1014 13:20:14.370243 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.471752 master-0 kubenswrapper[4807]: E1014 13:20:14.471424 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.572259 master-0 kubenswrapper[4807]: E1014 13:20:14.572046 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.673085 master-0 kubenswrapper[4807]: E1014 13:20:14.672953 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.774585 master-0 kubenswrapper[4807]: E1014 13:20:14.774159 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.875429 master-0 kubenswrapper[4807]: E1014 13:20:14.875305 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:14.943707 master-0 kubenswrapper[4807]: I1014 13:20:14.943501 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37304: no serving certificate available for the kubelet" Oct 14 13:20:14.954069 master-0 kubenswrapper[4807]: I1014 13:20:14.953989 4807 reflector.go:368] Caches populated for *v1.Service from k8s.io/client-go/informers/factory.go:160 Oct 14 13:20:14.975995 master-0 kubenswrapper[4807]: E1014 13:20:14.975876 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.076962 master-0 kubenswrapper[4807]: E1014 13:20:15.076601 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.177653 master-0 kubenswrapper[4807]: E1014 13:20:15.177523 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.278498 master-0 kubenswrapper[4807]: E1014 13:20:15.278312 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.379429 master-0 kubenswrapper[4807]: E1014 13:20:15.379292 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.480499 master-0 kubenswrapper[4807]: E1014 13:20:15.480314 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.580851 master-0 kubenswrapper[4807]: E1014 13:20:15.580712 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.664636 master-0 kubenswrapper[4807]: I1014 13:20:15.664384 4807 reflector.go:368] Caches populated for *v1.RuntimeClass from k8s.io/client-go/informers/factory.go:160 Oct 14 13:20:15.681351 master-0 kubenswrapper[4807]: E1014 13:20:15.681264 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.781731 master-0 kubenswrapper[4807]: E1014 13:20:15.781634 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.786240 master-0 kubenswrapper[4807]: I1014 13:20:15.786148 4807 reflector.go:368] Caches populated for *v1.CSIDriver from k8s.io/client-go/informers/factory.go:160 Oct 14 13:20:15.883031 master-0 kubenswrapper[4807]: E1014 13:20:15.882858 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:15.984308 master-0 kubenswrapper[4807]: E1014 13:20:15.984006 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:16.084356 master-0 kubenswrapper[4807]: E1014 13:20:16.084269 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:16.185381 master-0 kubenswrapper[4807]: E1014 13:20:16.185303 4807 kubelet_node_status.go:503] "Error getting the current node from lister" err="node \"master-0\" not found" Oct 14 13:20:16.219046 master-0 kubenswrapper[4807]: I1014 13:20:16.218957 4807 reflector.go:368] Caches populated for *v1.Node from k8s.io/client-go/informers/factory.go:160 Oct 14 13:20:16.274389 master-0 kubenswrapper[4807]: I1014 13:20:16.274170 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37316: no serving certificate available for the kubelet" Oct 14 13:20:18.685553 master-0 kubenswrapper[4807]: I1014 13:20:18.685505 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-5-master-0"] Oct 14 13:20:18.686600 master-0 kubenswrapper[4807]: I1014 13:20:18.686568 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.686862 master-0 kubenswrapper[4807]: E1014 13:20:18.686807 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-5-master-0" podUID="064529c8-7575-4dca-9394-acdcc896c800" Oct 14 13:20:18.806517 master-0 kubenswrapper[4807]: I1014 13:20:18.806355 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.806517 master-0 kubenswrapper[4807]: I1014 13:20:18.806442 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.806936 master-0 kubenswrapper[4807]: I1014 13:20:18.806550 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.876083 master-0 kubenswrapper[4807]: I1014 13:20:18.875957 4807 ???:1] "http: TLS handshake error from 192.168.34.11:37326: no serving certificate available for the kubelet" Oct 14 13:20:18.907229 master-0 kubenswrapper[4807]: I1014 13:20:18.907112 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.907229 master-0 kubenswrapper[4807]: I1014 13:20:18.907194 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.907649 master-0 kubenswrapper[4807]: I1014 13:20:18.907240 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.907649 master-0 kubenswrapper[4807]: I1014 13:20:18.907321 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.907649 master-0 kubenswrapper[4807]: I1014 13:20:18.907422 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:18.975735 master-0 kubenswrapper[4807]: E1014 13:20:18.975543 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:18.975735 master-0 kubenswrapper[4807]: E1014 13:20:18.975605 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-5-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:18.976035 master-0 kubenswrapper[4807]: E1014 13:20:18.975743 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access podName:064529c8-7575-4dca-9394-acdcc896c800 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:19.475701366 +0000 UTC m=+14.157003230 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access") pod "installer-5-master-0" (UID: "064529c8-7575-4dca-9394-acdcc896c800") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:19.099058 master-0 kubenswrapper[4807]: I1014 13:20:19.098940 4807 ???:1] "http: TLS handshake error from 192.168.34.11:39362: no serving certificate available for the kubelet" Oct 14 13:20:19.511072 master-0 kubenswrapper[4807]: E1014 13:20:19.510936 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:19.511072 master-0 kubenswrapper[4807]: E1014 13:20:19.511002 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-5-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:19.511072 master-0 kubenswrapper[4807]: E1014 13:20:19.511070 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access podName:064529c8-7575-4dca-9394-acdcc896c800 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:20.511046196 +0000 UTC m=+15.192348050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access") pod "installer-5-master-0" (UID: "064529c8-7575-4dca-9394-acdcc896c800") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:19.511509 master-0 kubenswrapper[4807]: I1014 13:20:19.510935 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:19.797193 master-0 kubenswrapper[4807]: I1014 13:20:19.797018 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:20:19.797900 master-0 kubenswrapper[4807]: I1014 13:20:19.797338 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:19.797900 master-0 kubenswrapper[4807]: E1014 13:20:19.797450 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:19.915511 master-0 kubenswrapper[4807]: I1014 13:20:19.915314 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:19.915511 master-0 kubenswrapper[4807]: I1014 13:20:19.915404 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:19.915511 master-0 kubenswrapper[4807]: I1014 13:20:19.915436 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.016405 master-0 kubenswrapper[4807]: I1014 13:20:20.016293 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.016405 master-0 kubenswrapper[4807]: I1014 13:20:20.016389 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.016808 master-0 kubenswrapper[4807]: I1014 13:20:20.016498 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.016808 master-0 kubenswrapper[4807]: I1014 13:20:20.016510 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.016808 master-0 kubenswrapper[4807]: I1014 13:20:20.016627 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.047737 master-0 kubenswrapper[4807]: E1014 13:20:20.047552 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:20.047737 master-0 kubenswrapper[4807]: E1014 13:20:20.047610 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:20.047737 master-0 kubenswrapper[4807]: E1014 13:20:20.047706 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:20.547675179 +0000 UTC m=+15.228977003 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:20.261593 master-0 kubenswrapper[4807]: I1014 13:20:20.261533 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:20.262053 master-0 kubenswrapper[4807]: E1014 13:20:20.262010 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-5-master-0" podUID="064529c8-7575-4dca-9394-acdcc896c800" Oct 14 13:20:20.520086 master-0 kubenswrapper[4807]: I1014 13:20:20.519955 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:20.520487 master-0 kubenswrapper[4807]: E1014 13:20:20.520363 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:20.520574 master-0 kubenswrapper[4807]: E1014 13:20:20.520485 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-5-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:20.520642 master-0 kubenswrapper[4807]: E1014 13:20:20.520615 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access podName:064529c8-7575-4dca-9394-acdcc896c800 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:22.520574689 +0000 UTC m=+17.201876543 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access") pod "installer-5-master-0" (UID: "064529c8-7575-4dca-9394-acdcc896c800") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:20.621499 master-0 kubenswrapper[4807]: I1014 13:20:20.621289 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:20.621853 master-0 kubenswrapper[4807]: E1014 13:20:20.621784 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:20.621853 master-0 kubenswrapper[4807]: E1014 13:20:20.621842 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:20.622089 master-0 kubenswrapper[4807]: E1014 13:20:20.622048 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:21.621959741 +0000 UTC m=+16.303261715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:21.261210 master-0 kubenswrapper[4807]: I1014 13:20:21.261103 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:21.262298 master-0 kubenswrapper[4807]: E1014 13:20:21.261273 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:21.629523 master-0 kubenswrapper[4807]: I1014 13:20:21.629408 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:21.629772 master-0 kubenswrapper[4807]: E1014 13:20:21.629720 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:21.629772 master-0 kubenswrapper[4807]: E1014 13:20:21.629765 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:21.629958 master-0 kubenswrapper[4807]: E1014 13:20:21.629853 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:23.62982618 +0000 UTC m=+18.311128034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:22.262080 master-0 kubenswrapper[4807]: I1014 13:20:22.261955 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:22.263048 master-0 kubenswrapper[4807]: E1014 13:20:22.262208 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-5-master-0" podUID="064529c8-7575-4dca-9394-acdcc896c800" Oct 14 13:20:22.534643 master-0 kubenswrapper[4807]: I1014 13:20:22.534357 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:22.534882 master-0 kubenswrapper[4807]: E1014 13:20:22.534701 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:22.534882 master-0 kubenswrapper[4807]: E1014 13:20:22.534765 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-5-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:22.534882 master-0 kubenswrapper[4807]: E1014 13:20:22.534871 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access podName:064529c8-7575-4dca-9394-acdcc896c800 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:26.534835822 +0000 UTC m=+21.216137806 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access") pod "installer-5-master-0" (UID: "064529c8-7575-4dca-9394-acdcc896c800") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:23.262234 master-0 kubenswrapper[4807]: I1014 13:20:23.262073 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:23.263081 master-0 kubenswrapper[4807]: E1014 13:20:23.262252 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:23.642129 master-0 kubenswrapper[4807]: I1014 13:20:23.641974 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:23.642375 master-0 kubenswrapper[4807]: E1014 13:20:23.642212 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:23.642375 master-0 kubenswrapper[4807]: E1014 13:20:23.642237 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:23.642375 master-0 kubenswrapper[4807]: E1014 13:20:23.642318 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:27.642294448 +0000 UTC m=+22.323596272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:24.035143 master-0 kubenswrapper[4807]: I1014 13:20:24.034960 4807 ???:1] "http: TLS handshake error from 192.168.34.11:46748: no serving certificate available for the kubelet" Oct 14 13:20:24.262197 master-0 kubenswrapper[4807]: I1014 13:20:24.262066 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:24.262533 master-0 kubenswrapper[4807]: E1014 13:20:24.262314 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-5-master-0" podUID="064529c8-7575-4dca-9394-acdcc896c800" Oct 14 13:20:25.261724 master-0 kubenswrapper[4807]: I1014 13:20:25.261654 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:25.262020 master-0 kubenswrapper[4807]: E1014 13:20:25.261846 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:26.261702 master-0 kubenswrapper[4807]: I1014 13:20:26.261614 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:26.262313 master-0 kubenswrapper[4807]: E1014 13:20:26.261782 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-5-master-0" podUID="064529c8-7575-4dca-9394-acdcc896c800" Oct 14 13:20:26.564248 master-0 kubenswrapper[4807]: I1014 13:20:26.564076 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") pod \"installer-5-master-0\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:26.564531 master-0 kubenswrapper[4807]: E1014 13:20:26.564286 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:26.564531 master-0 kubenswrapper[4807]: E1014 13:20:26.564320 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-5-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:26.564531 master-0 kubenswrapper[4807]: E1014 13:20:26.564398 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access podName:064529c8-7575-4dca-9394-acdcc896c800 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:34.564371024 +0000 UTC m=+29.245672888 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access") pod "installer-5-master-0" (UID: "064529c8-7575-4dca-9394-acdcc896c800") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:27.262195 master-0 kubenswrapper[4807]: I1014 13:20:27.262093 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:27.263038 master-0 kubenswrapper[4807]: E1014 13:20:27.262296 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:27.274348 master-0 kubenswrapper[4807]: I1014 13:20:27.274302 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-5-master-0"] Oct 14 13:20:27.274429 master-0 kubenswrapper[4807]: I1014 13:20:27.274390 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:27.300366 master-0 kubenswrapper[4807]: I1014 13:20:27.300268 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:27.323598 master-0 kubenswrapper[4807]: I1014 13:20:27.323509 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-5-master-0" Oct 14 13:20:27.371592 master-0 kubenswrapper[4807]: I1014 13:20:27.371521 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock\") pod \"064529c8-7575-4dca-9394-acdcc896c800\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " Oct 14 13:20:27.371592 master-0 kubenswrapper[4807]: I1014 13:20:27.371588 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir\") pod \"064529c8-7575-4dca-9394-acdcc896c800\" (UID: \"064529c8-7575-4dca-9394-acdcc896c800\") " Oct 14 13:20:27.371756 master-0 kubenswrapper[4807]: I1014 13:20:27.371523 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock" (OuterVolumeSpecName: "var-lock") pod "064529c8-7575-4dca-9394-acdcc896c800" (UID: "064529c8-7575-4dca-9394-acdcc896c800"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:20:27.371756 master-0 kubenswrapper[4807]: I1014 13:20:27.371677 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:27.371756 master-0 kubenswrapper[4807]: I1014 13:20:27.371735 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "064529c8-7575-4dca-9394-acdcc896c800" (UID: "064529c8-7575-4dca-9394-acdcc896c800"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:20:27.472578 master-0 kubenswrapper[4807]: I1014 13:20:27.472424 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/064529c8-7575-4dca-9394-acdcc896c800-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:27.673276 master-0 kubenswrapper[4807]: I1014 13:20:27.673157 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:27.673636 master-0 kubenswrapper[4807]: E1014 13:20:27.673400 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:27.673636 master-0 kubenswrapper[4807]: E1014 13:20:27.673440 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:27.673636 master-0 kubenswrapper[4807]: E1014 13:20:27.673564 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:35.673533765 +0000 UTC m=+30.354835629 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:27.674262 master-0 kubenswrapper[4807]: I1014 13:20:27.674198 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-5-master-0"] Oct 14 13:20:27.682074 master-0 kubenswrapper[4807]: I1014 13:20:27.682024 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/installer-5-master-0"] Oct 14 13:20:27.773825 master-0 kubenswrapper[4807]: I1014 13:20:27.773726 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/064529c8-7575-4dca-9394-acdcc896c800-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:28.295358 master-0 kubenswrapper[4807]: I1014 13:20:28.295258 4807 scope.go:117] "RemoveContainer" containerID="580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb" Oct 14 13:20:28.295358 master-0 kubenswrapper[4807]: I1014 13:20:28.295307 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-master-0"] Oct 14 13:20:29.261741 master-0 kubenswrapper[4807]: I1014 13:20:29.261666 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:29.261976 master-0 kubenswrapper[4807]: E1014 13:20:29.261797 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:29.328916 master-0 kubenswrapper[4807]: I1014 13:20:29.328863 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/2.log" Oct 14 13:20:29.329583 master-0 kubenswrapper[4807]: I1014 13:20:29.329376 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/1.log" Oct 14 13:20:29.329977 master-0 kubenswrapper[4807]: I1014 13:20:29.329915 4807 generic.go:334] "Generic (PLEG): container finished" podID="117b8efe269c98124cf5022ab3c340a5" containerID="d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125" exitCode=1 Oct 14 13:20:29.330062 master-0 kubenswrapper[4807]: I1014 13:20:29.329982 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerDied","Data":"d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125"} Oct 14 13:20:29.330062 master-0 kubenswrapper[4807]: I1014 13:20:29.330041 4807 scope.go:117] "RemoveContainer" containerID="580f9518ab00bf1ae553434c0e1e8edfdcbd919348858502d1f4adad82bf0efb" Oct 14 13:20:29.342120 master-0 kubenswrapper[4807]: I1014 13:20:29.342079 4807 scope.go:117] "RemoveContainer" containerID="d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125" Oct 14 13:20:29.342284 master-0 kubenswrapper[4807]: E1014 13:20:29.342247 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(117b8efe269c98124cf5022ab3c340a5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="117b8efe269c98124cf5022ab3c340a5" Oct 14 13:20:30.334266 master-0 kubenswrapper[4807]: I1014 13:20:30.334201 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/2.log" Oct 14 13:20:30.335423 master-0 kubenswrapper[4807]: I1014 13:20:30.335376 4807 scope.go:117] "RemoveContainer" containerID="d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125" Oct 14 13:20:30.335684 master-0 kubenswrapper[4807]: E1014 13:20:30.335639 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(117b8efe269c98124cf5022ab3c340a5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="117b8efe269c98124cf5022ab3c340a5" Oct 14 13:20:30.684962 master-0 kubenswrapper[4807]: I1014 13:20:30.684841 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-6-master-0"] Oct 14 13:20:30.685227 master-0 kubenswrapper[4807]: I1014 13:20:30.685186 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.685354 master-0 kubenswrapper[4807]: E1014 13:20:30.685302 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:30.794504 master-0 kubenswrapper[4807]: I1014 13:20:30.794372 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.794504 master-0 kubenswrapper[4807]: I1014 13:20:30.794450 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.794783 master-0 kubenswrapper[4807]: I1014 13:20:30.794559 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.895314 master-0 kubenswrapper[4807]: I1014 13:20:30.895189 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.895314 master-0 kubenswrapper[4807]: I1014 13:20:30.895260 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.895314 master-0 kubenswrapper[4807]: I1014 13:20:30.895300 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.895714 master-0 kubenswrapper[4807]: I1014 13:20:30.895342 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.895714 master-0 kubenswrapper[4807]: I1014 13:20:30.895418 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:30.918850 master-0 kubenswrapper[4807]: E1014 13:20:30.918734 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:30.918850 master-0 kubenswrapper[4807]: E1014 13:20:30.918788 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:30.919129 master-0 kubenswrapper[4807]: E1014 13:20:30.918878 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:31.41884412 +0000 UTC m=+26.100145984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:31.261295 master-0 kubenswrapper[4807]: I1014 13:20:31.261157 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:31.261587 master-0 kubenswrapper[4807]: E1014 13:20:31.261486 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:31.499730 master-0 kubenswrapper[4807]: I1014 13:20:31.499623 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:31.500520 master-0 kubenswrapper[4807]: E1014 13:20:31.499797 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:31.500520 master-0 kubenswrapper[4807]: E1014 13:20:31.499821 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:31.500520 master-0 kubenswrapper[4807]: E1014 13:20:31.499883 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:32.499864585 +0000 UTC m=+27.181166409 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:32.261432 master-0 kubenswrapper[4807]: I1014 13:20:32.261329 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:32.261769 master-0 kubenswrapper[4807]: E1014 13:20:32.261523 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:32.508256 master-0 kubenswrapper[4807]: I1014 13:20:32.508175 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:32.509242 master-0 kubenswrapper[4807]: E1014 13:20:32.508403 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:32.509242 master-0 kubenswrapper[4807]: E1014 13:20:32.508435 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:32.509242 master-0 kubenswrapper[4807]: E1014 13:20:32.508556 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:34.508526905 +0000 UTC m=+29.189828759 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:33.261835 master-0 kubenswrapper[4807]: I1014 13:20:33.261772 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:33.262064 master-0 kubenswrapper[4807]: E1014 13:20:33.261965 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:34.105083 master-0 kubenswrapper[4807]: I1014 13:20:34.104959 4807 ???:1] "http: TLS handshake error from 192.168.34.11:34432: no serving certificate available for the kubelet" Oct 14 13:20:34.261437 master-0 kubenswrapper[4807]: I1014 13:20:34.261337 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:34.261727 master-0 kubenswrapper[4807]: E1014 13:20:34.261545 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:34.320970 master-0 kubenswrapper[4807]: I1014 13:20:34.320901 4807 ???:1] "http: TLS handshake error from 192.168.34.11:50494: no serving certificate available for the kubelet" Oct 14 13:20:34.522224 master-0 kubenswrapper[4807]: I1014 13:20:34.522128 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:34.522614 master-0 kubenswrapper[4807]: E1014 13:20:34.522420 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:34.522614 master-0 kubenswrapper[4807]: E1014 13:20:34.522509 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:34.522614 master-0 kubenswrapper[4807]: E1014 13:20:34.522612 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:38.522580034 +0000 UTC m=+33.203881888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:35.261921 master-0 kubenswrapper[4807]: I1014 13:20:35.261821 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:35.262449 master-0 kubenswrapper[4807]: E1014 13:20:35.262013 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:35.730498 master-0 kubenswrapper[4807]: I1014 13:20:35.730290 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:35.730731 master-0 kubenswrapper[4807]: E1014 13:20:35.730575 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:35.730731 master-0 kubenswrapper[4807]: E1014 13:20:35.730626 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:35.730731 master-0 kubenswrapper[4807]: E1014 13:20:35.730722 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:51.730693392 +0000 UTC m=+46.411995256 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:36.262131 master-0 kubenswrapper[4807]: I1014 13:20:36.262001 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:36.262950 master-0 kubenswrapper[4807]: E1014 13:20:36.262391 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:37.261239 master-0 kubenswrapper[4807]: I1014 13:20:37.261166 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:37.261739 master-0 kubenswrapper[4807]: E1014 13:20:37.261396 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:38.262144 master-0 kubenswrapper[4807]: I1014 13:20:38.262070 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:38.263037 master-0 kubenswrapper[4807]: E1014 13:20:38.262267 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:38.550125 master-0 kubenswrapper[4807]: I1014 13:20:38.549909 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:38.550125 master-0 kubenswrapper[4807]: E1014 13:20:38.550116 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:38.550777 master-0 kubenswrapper[4807]: E1014 13:20:38.550159 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:38.550777 master-0 kubenswrapper[4807]: E1014 13:20:38.550523 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:20:46.550228428 +0000 UTC m=+41.231530292 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:39.262180 master-0 kubenswrapper[4807]: I1014 13:20:39.262061 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:39.263021 master-0 kubenswrapper[4807]: E1014 13:20:39.262253 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:40.077362 master-0 kubenswrapper[4807]: I1014 13:20:40.077287 4807 csr.go:261] certificate signing request csr-xdd56 is approved, waiting to be issued Oct 14 13:20:40.091150 master-0 kubenswrapper[4807]: I1014 13:20:40.091104 4807 csr.go:257] certificate signing request csr-xdd56 is issued Oct 14 13:20:40.261418 master-0 kubenswrapper[4807]: I1014 13:20:40.261287 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:40.261720 master-0 kubenswrapper[4807]: E1014 13:20:40.261562 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:41.093289 master-0 kubenswrapper[4807]: I1014 13:20:41.093123 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-10-15 13:01:17 +0000 UTC, rotation deadline is 2025-10-15 07:12:04.095067068 +0000 UTC Oct 14 13:20:41.093289 master-0 kubenswrapper[4807]: I1014 13:20:41.093214 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 17h51m23.001860328s for next certificate rotation Oct 14 13:20:41.261874 master-0 kubenswrapper[4807]: I1014 13:20:41.261759 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:41.262143 master-0 kubenswrapper[4807]: E1014 13:20:41.261950 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:42.094495 master-0 kubenswrapper[4807]: I1014 13:20:42.094359 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Certificate expiration is 2025-10-15 13:01:17 +0000 UTC, rotation deadline is 2025-10-15 07:40:25.617545825 +0000 UTC Oct 14 13:20:42.094495 master-0 kubenswrapper[4807]: I1014 13:20:42.094417 4807 certificate_manager.go:356] kubernetes.io/kubelet-serving: Waiting 18h19m43.523133814s for next certificate rotation Oct 14 13:20:42.262062 master-0 kubenswrapper[4807]: I1014 13:20:42.261991 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:42.262282 master-0 kubenswrapper[4807]: E1014 13:20:42.262135 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:43.262305 master-0 kubenswrapper[4807]: I1014 13:20:43.262112 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:43.263146 master-0 kubenswrapper[4807]: E1014 13:20:43.262336 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:44.262074 master-0 kubenswrapper[4807]: I1014 13:20:44.261966 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:44.262343 master-0 kubenswrapper[4807]: E1014 13:20:44.262159 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:45.261677 master-0 kubenswrapper[4807]: I1014 13:20:45.261507 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:45.262592 master-0 kubenswrapper[4807]: E1014 13:20:45.261749 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:45.262592 master-0 kubenswrapper[4807]: I1014 13:20:45.262258 4807 scope.go:117] "RemoveContainer" containerID="d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125" Oct 14 13:20:45.262592 master-0 kubenswrapper[4807]: E1014 13:20:45.262565 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"kube-rbac-proxy-crio\" with CrashLoopBackOff: \"back-off 20s restarting failed container=kube-rbac-proxy-crio pod=kube-rbac-proxy-crio-master-0_openshift-machine-config-operator(117b8efe269c98124cf5022ab3c340a5)\"" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podUID="117b8efe269c98124cf5022ab3c340a5" Oct 14 13:20:46.261622 master-0 kubenswrapper[4807]: I1014 13:20:46.261434 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:46.261935 master-0 kubenswrapper[4807]: E1014 13:20:46.261710 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:46.608662 master-0 kubenswrapper[4807]: I1014 13:20:46.608554 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") pod \"installer-6-master-0\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:46.608942 master-0 kubenswrapper[4807]: E1014 13:20:46.608760 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:46.608942 master-0 kubenswrapper[4807]: E1014 13:20:46.608797 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-6-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:46.608942 master-0 kubenswrapper[4807]: E1014 13:20:46.608878 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access podName:4a8a8798-5ffd-4149-a7a7-f2155b168871 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:02.608852083 +0000 UTC m=+57.290153947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access") pod "installer-6-master-0" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:47.261673 master-0 kubenswrapper[4807]: I1014 13:20:47.261560 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:47.261976 master-0 kubenswrapper[4807]: E1014 13:20:47.261790 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:48.262300 master-0 kubenswrapper[4807]: I1014 13:20:48.262158 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:48.262300 master-0 kubenswrapper[4807]: E1014 13:20:48.262312 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-6-master-0" podUID="4a8a8798-5ffd-4149-a7a7-f2155b168871" Oct 14 13:20:49.261249 master-0 kubenswrapper[4807]: I1014 13:20:49.261134 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:49.261566 master-0 kubenswrapper[4807]: E1014 13:20:49.261325 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:49.476125 master-0 kubenswrapper[4807]: I1014 13:20:49.476015 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-6-master-0"] Oct 14 13:20:49.477049 master-0 kubenswrapper[4807]: I1014 13:20:49.476182 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:49.496661 master-0 kubenswrapper[4807]: I1014 13:20:49.496555 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:49.532275 master-0 kubenswrapper[4807]: I1014 13:20:49.532030 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock\") pod \"4a8a8798-5ffd-4149-a7a7-f2155b168871\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " Oct 14 13:20:49.532275 master-0 kubenswrapper[4807]: I1014 13:20:49.532129 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock" (OuterVolumeSpecName: "var-lock") pod "4a8a8798-5ffd-4149-a7a7-f2155b168871" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:20:49.532275 master-0 kubenswrapper[4807]: I1014 13:20:49.532239 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir\") pod \"4a8a8798-5ffd-4149-a7a7-f2155b168871\" (UID: \"4a8a8798-5ffd-4149-a7a7-f2155b168871\") " Oct 14 13:20:49.532671 master-0 kubenswrapper[4807]: I1014 13:20:49.532372 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:49.532671 master-0 kubenswrapper[4807]: I1014 13:20:49.532518 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "4a8a8798-5ffd-4149-a7a7-f2155b168871" (UID: "4a8a8798-5ffd-4149-a7a7-f2155b168871"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:20:49.633749 master-0 kubenswrapper[4807]: I1014 13:20:49.633567 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4a8a8798-5ffd-4149-a7a7-f2155b168871-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:50.377951 master-0 kubenswrapper[4807]: I1014 13:20:50.377840 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-6-master-0" Oct 14 13:20:50.427868 master-0 kubenswrapper[4807]: I1014 13:20:50.427753 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-6-master-0"] Oct 14 13:20:50.434269 master-0 kubenswrapper[4807]: I1014 13:20:50.434204 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/installer-6-master-0"] Oct 14 13:20:50.542008 master-0 kubenswrapper[4807]: I1014 13:20:50.541857 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/4a8a8798-5ffd-4149-a7a7-f2155b168871-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:20:51.262145 master-0 kubenswrapper[4807]: I1014 13:20:51.262012 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:51.262607 master-0 kubenswrapper[4807]: E1014 13:20:51.262261 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:51.751853 master-0 kubenswrapper[4807]: I1014 13:20:51.751697 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:51.752958 master-0 kubenswrapper[4807]: E1014 13:20:51.752027 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:51.752958 master-0 kubenswrapper[4807]: E1014 13:20:51.752107 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:51.752958 master-0 kubenswrapper[4807]: E1014 13:20:51.752222 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:21:23.752187026 +0000 UTC m=+78.433488890 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:20:53.261980 master-0 kubenswrapper[4807]: I1014 13:20:53.261853 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:53.263072 master-0 kubenswrapper[4807]: E1014 13:20:53.262095 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:53.472200 master-0 kubenswrapper[4807]: I1014 13:20:53.472074 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-7-master-0"] Oct 14 13:20:53.472630 master-0 kubenswrapper[4807]: I1014 13:20:53.472557 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.472732 master-0 kubenswrapper[4807]: E1014 13:20:53.472680 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-7-master-0" podUID="a9dea7e7-693f-47f5-83cc-62bac54657fc" Oct 14 13:20:53.564104 master-0 kubenswrapper[4807]: I1014 13:20:53.563884 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.564104 master-0 kubenswrapper[4807]: I1014 13:20:53.564011 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.564104 master-0 kubenswrapper[4807]: I1014 13:20:53.564051 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.665513 master-0 kubenswrapper[4807]: I1014 13:20:53.665338 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.665513 master-0 kubenswrapper[4807]: I1014 13:20:53.665423 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.665513 master-0 kubenswrapper[4807]: I1014 13:20:53.665489 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.666212 master-0 kubenswrapper[4807]: I1014 13:20:53.665558 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.666212 master-0 kubenswrapper[4807]: I1014 13:20:53.665570 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:53.693452 master-0 kubenswrapper[4807]: E1014 13:20:53.693349 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:53.693452 master-0 kubenswrapper[4807]: E1014 13:20:53.693419 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-7-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:53.693874 master-0 kubenswrapper[4807]: E1014 13:20:53.693559 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access podName:a9dea7e7-693f-47f5-83cc-62bac54657fc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:54.19352286 +0000 UTC m=+48.874824714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access") pod "installer-7-master-0" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:54.269998 master-0 kubenswrapper[4807]: I1014 13:20:54.269888 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:54.271382 master-0 kubenswrapper[4807]: E1014 13:20:54.270061 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:54.271382 master-0 kubenswrapper[4807]: E1014 13:20:54.270082 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-7-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:54.271382 master-0 kubenswrapper[4807]: E1014 13:20:54.270141 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access podName:a9dea7e7-693f-47f5-83cc-62bac54657fc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:55.270118703 +0000 UTC m=+49.951420527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access") pod "installer-7-master-0" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:55.262084 master-0 kubenswrapper[4807]: I1014 13:20:55.261944 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:55.262498 master-0 kubenswrapper[4807]: I1014 13:20:55.262010 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:55.262498 master-0 kubenswrapper[4807]: E1014 13:20:55.262176 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:55.262498 master-0 kubenswrapper[4807]: E1014 13:20:55.262349 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-7-master-0" podUID="a9dea7e7-693f-47f5-83cc-62bac54657fc" Oct 14 13:20:55.275599 master-0 kubenswrapper[4807]: I1014 13:20:55.275512 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:55.276025 master-0 kubenswrapper[4807]: E1014 13:20:55.275741 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:55.276025 master-0 kubenswrapper[4807]: E1014 13:20:55.275769 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-7-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:55.276025 master-0 kubenswrapper[4807]: E1014 13:20:55.275845 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access podName:a9dea7e7-693f-47f5-83cc-62bac54657fc nodeName:}" failed. No retries permitted until 2025-10-14 13:20:57.275817968 +0000 UTC m=+51.957119832 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access") pod "installer-7-master-0" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:56.276937 master-0 kubenswrapper[4807]: I1014 13:20:56.276733 4807 scope.go:117] "RemoveContainer" containerID="d098147f6734eef9bef60e961b9fcaba3d2e770f61e83c4190f3e8578402c125" Oct 14 13:20:57.262295 master-0 kubenswrapper[4807]: I1014 13:20:57.262186 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:57.262295 master-0 kubenswrapper[4807]: I1014 13:20:57.262245 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:57.262632 master-0 kubenswrapper[4807]: E1014 13:20:57.262381 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-7-master-0" podUID="a9dea7e7-693f-47f5-83cc-62bac54657fc" Oct 14 13:20:57.262632 master-0 kubenswrapper[4807]: E1014 13:20:57.262517 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:20:57.294592 master-0 kubenswrapper[4807]: I1014 13:20:57.294501 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:57.295126 master-0 kubenswrapper[4807]: E1014 13:20:57.294766 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:57.295126 master-0 kubenswrapper[4807]: E1014 13:20:57.294806 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-7-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:57.295126 master-0 kubenswrapper[4807]: E1014 13:20:57.294887 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access podName:a9dea7e7-693f-47f5-83cc-62bac54657fc nodeName:}" failed. No retries permitted until 2025-10-14 13:21:01.294863625 +0000 UTC m=+55.976165539 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access") pod "installer-7-master-0" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:20:57.395679 master-0 kubenswrapper[4807]: I1014 13:20:57.395604 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-machine-config-operator_kube-rbac-proxy-crio-master-0_117b8efe269c98124cf5022ab3c340a5/kube-rbac-proxy-crio/2.log" Oct 14 13:20:57.396270 master-0 kubenswrapper[4807]: I1014 13:20:57.396200 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" event={"ID":"117b8efe269c98124cf5022ab3c340a5","Type":"ContainerStarted","Data":"2a0a40e0cf5ab4773e8d3f469427072d49b2b3c3ecac6539d85dc18ccff5f20f"} Oct 14 13:20:59.262280 master-0 kubenswrapper[4807]: I1014 13:20:59.262200 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:20:59.263368 master-0 kubenswrapper[4807]: I1014 13:20:59.262208 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:20:59.263687 master-0 kubenswrapper[4807]: E1014 13:20:59.263615 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-7-master-0" podUID="a9dea7e7-693f-47f5-83cc-62bac54657fc" Oct 14 13:20:59.263687 master-0 kubenswrapper[4807]: E1014 13:20:59.263375 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:01.261616 master-0 kubenswrapper[4807]: I1014 13:21:01.261361 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:01.261616 master-0 kubenswrapper[4807]: I1014 13:21:01.261429 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:21:01.261616 master-0 kubenswrapper[4807]: E1014 13:21:01.261532 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:01.262153 master-0 kubenswrapper[4807]: E1014 13:21:01.261721 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-7-master-0" podUID="a9dea7e7-693f-47f5-83cc-62bac54657fc" Oct 14 13:21:01.276294 master-0 kubenswrapper[4807]: I1014 13:21:01.276156 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-master-0" podStartSLOduration=33.276112944 podStartE2EDuration="33.276112944s" podCreationTimestamp="2025-10-14 13:20:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:20:57.427160163 +0000 UTC m=+52.108462027" watchObservedRunningTime="2025-10-14 13:21:01.276112944 +0000 UTC m=+55.957414808" Oct 14 13:21:01.276748 master-0 kubenswrapper[4807]: I1014 13:21:01.276700 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-7-master-0"] Oct 14 13:21:01.322719 master-0 kubenswrapper[4807]: I1014 13:21:01.322587 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") pod \"installer-7-master-0\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " pod="openshift-etcd/installer-7-master-0" Oct 14 13:21:01.322958 master-0 kubenswrapper[4807]: E1014 13:21:01.322910 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:01.322999 master-0 kubenswrapper[4807]: E1014 13:21:01.322977 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-7-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:01.323301 master-0 kubenswrapper[4807]: E1014 13:21:01.323266 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access podName:a9dea7e7-693f-47f5-83cc-62bac54657fc nodeName:}" failed. No retries permitted until 2025-10-14 13:21:09.323046333 +0000 UTC m=+64.004348367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access") pod "installer-7-master-0" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:01.405384 master-0 kubenswrapper[4807]: I1014 13:21:01.405307 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:21:01.414444 master-0 kubenswrapper[4807]: I1014 13:21:01.414379 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:21:01.524323 master-0 kubenswrapper[4807]: I1014 13:21:01.524143 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock\") pod \"a9dea7e7-693f-47f5-83cc-62bac54657fc\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " Oct 14 13:21:01.524323 master-0 kubenswrapper[4807]: I1014 13:21:01.524227 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir\") pod \"a9dea7e7-693f-47f5-83cc-62bac54657fc\" (UID: \"a9dea7e7-693f-47f5-83cc-62bac54657fc\") " Oct 14 13:21:01.524323 master-0 kubenswrapper[4807]: I1014 13:21:01.524314 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock" (OuterVolumeSpecName: "var-lock") pod "a9dea7e7-693f-47f5-83cc-62bac54657fc" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:21:01.524638 master-0 kubenswrapper[4807]: I1014 13:21:01.524348 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "a9dea7e7-693f-47f5-83cc-62bac54657fc" (UID: "a9dea7e7-693f-47f5-83cc-62bac54657fc"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:21:01.625445 master-0 kubenswrapper[4807]: I1014 13:21:01.625340 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:21:01.625445 master-0 kubenswrapper[4807]: I1014 13:21:01.625421 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9dea7e7-693f-47f5-83cc-62bac54657fc-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:21:02.407671 master-0 kubenswrapper[4807]: I1014 13:21:02.407572 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-7-master-0" Oct 14 13:21:02.452496 master-0 kubenswrapper[4807]: I1014 13:21:02.452406 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/installer-7-master-0"] Oct 14 13:21:02.464211 master-0 kubenswrapper[4807]: I1014 13:21:02.464085 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/installer-7-master-0"] Oct 14 13:21:02.533340 master-0 kubenswrapper[4807]: I1014 13:21:02.533269 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/a9dea7e7-693f-47f5-83cc-62bac54657fc-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:21:03.261529 master-0 kubenswrapper[4807]: I1014 13:21:03.261451 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:03.262003 master-0 kubenswrapper[4807]: E1014 13:21:03.261966 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:04.674118 master-0 kubenswrapper[4807]: I1014 13:21:04.674045 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-8-master-0"] Oct 14 13:21:04.674692 master-0 kubenswrapper[4807]: I1014 13:21:04.674337 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.674692 master-0 kubenswrapper[4807]: E1014 13:21:04.674423 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:04.746271 master-0 kubenswrapper[4807]: I1014 13:21:04.746193 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.746271 master-0 kubenswrapper[4807]: I1014 13:21:04.746266 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.746645 master-0 kubenswrapper[4807]: I1014 13:21:04.746336 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.847375 master-0 kubenswrapper[4807]: I1014 13:21:04.847293 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.847375 master-0 kubenswrapper[4807]: I1014 13:21:04.847358 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.847375 master-0 kubenswrapper[4807]: I1014 13:21:04.847378 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.847713 master-0 kubenswrapper[4807]: I1014 13:21:04.847612 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.847904 master-0 kubenswrapper[4807]: I1014 13:21:04.847861 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:04.870139 master-0 kubenswrapper[4807]: E1014 13:21:04.870075 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:04.870534 master-0 kubenswrapper[4807]: E1014 13:21:04.870441 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:04.870796 master-0 kubenswrapper[4807]: E1014 13:21:04.870769 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:05.370731313 +0000 UTC m=+60.052033177 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:05.261300 master-0 kubenswrapper[4807]: I1014 13:21:05.261126 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:05.261300 master-0 kubenswrapper[4807]: E1014 13:21:05.261305 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:05.451847 master-0 kubenswrapper[4807]: I1014 13:21:05.451692 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:05.452086 master-0 kubenswrapper[4807]: E1014 13:21:05.452009 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:05.452086 master-0 kubenswrapper[4807]: E1014 13:21:05.452075 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:05.452234 master-0 kubenswrapper[4807]: E1014 13:21:05.452173 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:06.4521434 +0000 UTC m=+61.133445264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:06.262088 master-0 kubenswrapper[4807]: I1014 13:21:06.262021 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:06.262991 master-0 kubenswrapper[4807]: E1014 13:21:06.262186 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:06.459511 master-0 kubenswrapper[4807]: I1014 13:21:06.459132 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:06.459511 master-0 kubenswrapper[4807]: E1014 13:21:06.459367 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:06.459511 master-0 kubenswrapper[4807]: E1014 13:21:06.459519 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:06.459904 master-0 kubenswrapper[4807]: E1014 13:21:06.459600 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:08.459576629 +0000 UTC m=+63.140878453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:07.261425 master-0 kubenswrapper[4807]: I1014 13:21:07.261324 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:07.261691 master-0 kubenswrapper[4807]: E1014 13:21:07.261519 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:08.261250 master-0 kubenswrapper[4807]: I1014 13:21:08.261173 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:08.261842 master-0 kubenswrapper[4807]: E1014 13:21:08.261358 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:08.477916 master-0 kubenswrapper[4807]: I1014 13:21:08.477797 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:08.478316 master-0 kubenswrapper[4807]: E1014 13:21:08.477961 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:08.478316 master-0 kubenswrapper[4807]: E1014 13:21:08.477984 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:08.478316 master-0 kubenswrapper[4807]: E1014 13:21:08.478046 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:12.478027308 +0000 UTC m=+67.159329132 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:09.261734 master-0 kubenswrapper[4807]: I1014 13:21:09.261627 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:09.262326 master-0 kubenswrapper[4807]: E1014 13:21:09.261810 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:10.262348 master-0 kubenswrapper[4807]: I1014 13:21:10.262188 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:10.262348 master-0 kubenswrapper[4807]: E1014 13:21:10.262337 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:11.261966 master-0 kubenswrapper[4807]: I1014 13:21:11.261846 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:11.262244 master-0 kubenswrapper[4807]: E1014 13:21:11.262093 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:12.262221 master-0 kubenswrapper[4807]: I1014 13:21:12.262121 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:12.263090 master-0 kubenswrapper[4807]: E1014 13:21:12.262236 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:12.505223 master-0 kubenswrapper[4807]: I1014 13:21:12.505116 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:12.505500 master-0 kubenswrapper[4807]: E1014 13:21:12.505344 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:12.505500 master-0 kubenswrapper[4807]: E1014 13:21:12.505378 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:12.505500 master-0 kubenswrapper[4807]: E1014 13:21:12.505484 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:20.50543257 +0000 UTC m=+75.186734424 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:13.261579 master-0 kubenswrapper[4807]: I1014 13:21:13.261410 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:13.261868 master-0 kubenswrapper[4807]: E1014 13:21:13.261637 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:14.261930 master-0 kubenswrapper[4807]: I1014 13:21:14.261775 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:14.262798 master-0 kubenswrapper[4807]: E1014 13:21:14.262068 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:15.262063 master-0 kubenswrapper[4807]: I1014 13:21:15.261951 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:15.262901 master-0 kubenswrapper[4807]: E1014 13:21:15.262148 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:16.262095 master-0 kubenswrapper[4807]: I1014 13:21:16.261958 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:16.263028 master-0 kubenswrapper[4807]: E1014 13:21:16.262324 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:17.262359 master-0 kubenswrapper[4807]: I1014 13:21:17.262196 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:17.263347 master-0 kubenswrapper[4807]: E1014 13:21:17.262527 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:18.262062 master-0 kubenswrapper[4807]: I1014 13:21:18.261916 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:18.262062 master-0 kubenswrapper[4807]: E1014 13:21:18.262059 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:19.261709 master-0 kubenswrapper[4807]: I1014 13:21:19.261663 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:19.262679 master-0 kubenswrapper[4807]: E1014 13:21:19.262632 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:20.261857 master-0 kubenswrapper[4807]: I1014 13:21:20.261765 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:20.263067 master-0 kubenswrapper[4807]: E1014 13:21:20.262837 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:20.562889 master-0 kubenswrapper[4807]: I1014 13:21:20.562690 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:20.562889 master-0 kubenswrapper[4807]: E1014 13:21:20.562827 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:20.562889 master-0 kubenswrapper[4807]: E1014 13:21:20.562857 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:20.563215 master-0 kubenswrapper[4807]: E1014 13:21:20.562943 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:21:36.562918203 +0000 UTC m=+91.244220057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:21.261209 master-0 kubenswrapper[4807]: I1014 13:21:21.261108 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:21.261560 master-0 kubenswrapper[4807]: E1014 13:21:21.261282 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:22.261789 master-0 kubenswrapper[4807]: I1014 13:21:22.261704 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:22.262327 master-0 kubenswrapper[4807]: E1014 13:21:22.261849 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:23.262066 master-0 kubenswrapper[4807]: I1014 13:21:23.261955 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:23.262889 master-0 kubenswrapper[4807]: E1014 13:21:23.262085 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:23.785898 master-0 kubenswrapper[4807]: I1014 13:21:23.785791 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:23.786200 master-0 kubenswrapper[4807]: E1014 13:21:23.786133 4807 projected.go:288] Couldn't get configMap openshift-kube-controller-manager/kube-root-ca.crt: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:21:23.786286 master-0 kubenswrapper[4807]: E1014 13:21:23.786200 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-controller-manager/installer-5-master-0: object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:21:23.786355 master-0 kubenswrapper[4807]: E1014 13:21:23.786327 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access podName:9e0b616f-6bb0-4490-ae29-fcc199223dfc nodeName:}" failed. No retries permitted until 2025-10-14 13:22:27.786290703 +0000 UTC m=+142.467592557 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access") pod "installer-5-master-0" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc") : object "openshift-kube-controller-manager"/"kube-root-ca.crt" not registered Oct 14 13:21:24.261702 master-0 kubenswrapper[4807]: I1014 13:21:24.261609 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:24.262065 master-0 kubenswrapper[4807]: E1014 13:21:24.261764 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:25.262015 master-0 kubenswrapper[4807]: I1014 13:21:25.261907 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:25.262828 master-0 kubenswrapper[4807]: E1014 13:21:25.262076 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:26.261901 master-0 kubenswrapper[4807]: I1014 13:21:26.261806 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:26.262197 master-0 kubenswrapper[4807]: E1014 13:21:26.262146 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:27.261489 master-0 kubenswrapper[4807]: I1014 13:21:27.261363 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:27.261784 master-0 kubenswrapper[4807]: E1014 13:21:27.261570 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:28.262221 master-0 kubenswrapper[4807]: I1014 13:21:28.262040 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:28.263533 master-0 kubenswrapper[4807]: E1014 13:21:28.262323 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:29.262196 master-0 kubenswrapper[4807]: I1014 13:21:29.262121 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:29.262419 master-0 kubenswrapper[4807]: E1014 13:21:29.262255 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:30.262308 master-0 kubenswrapper[4807]: I1014 13:21:30.262187 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:30.262611 master-0 kubenswrapper[4807]: E1014 13:21:30.262357 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:31.262170 master-0 kubenswrapper[4807]: I1014 13:21:31.262036 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:31.262170 master-0 kubenswrapper[4807]: E1014 13:21:31.262184 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:32.262229 master-0 kubenswrapper[4807]: I1014 13:21:32.262096 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:32.263059 master-0 kubenswrapper[4807]: E1014 13:21:32.262388 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:33.261746 master-0 kubenswrapper[4807]: I1014 13:21:33.261604 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:33.265067 master-0 kubenswrapper[4807]: E1014 13:21:33.261785 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:34.262254 master-0 kubenswrapper[4807]: I1014 13:21:34.262188 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:34.262455 master-0 kubenswrapper[4807]: E1014 13:21:34.262327 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:35.261598 master-0 kubenswrapper[4807]: I1014 13:21:35.261516 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:35.262280 master-0 kubenswrapper[4807]: E1014 13:21:35.261686 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:36.262082 master-0 kubenswrapper[4807]: I1014 13:21:36.261929 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:36.263060 master-0 kubenswrapper[4807]: E1014 13:21:36.262154 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:36.621646 master-0 kubenswrapper[4807]: I1014 13:21:36.621408 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:36.622166 master-0 kubenswrapper[4807]: E1014 13:21:36.621810 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:36.622166 master-0 kubenswrapper[4807]: E1014 13:21:36.621888 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:36.622166 master-0 kubenswrapper[4807]: E1014 13:21:36.622005 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:22:08.621966978 +0000 UTC m=+123.303268952 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:21:37.261911 master-0 kubenswrapper[4807]: I1014 13:21:37.261818 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:37.262171 master-0 kubenswrapper[4807]: E1014 13:21:37.261994 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:38.262427 master-0 kubenswrapper[4807]: I1014 13:21:38.262272 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:38.263767 master-0 kubenswrapper[4807]: E1014 13:21:38.262639 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:39.261281 master-0 kubenswrapper[4807]: I1014 13:21:39.261163 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:39.261842 master-0 kubenswrapper[4807]: E1014 13:21:39.261440 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:40.262083 master-0 kubenswrapper[4807]: I1014 13:21:40.261998 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:40.262938 master-0 kubenswrapper[4807]: E1014 13:21:40.262163 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:41.261367 master-0 kubenswrapper[4807]: I1014 13:21:41.261318 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:41.261886 master-0 kubenswrapper[4807]: E1014 13:21:41.261840 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:42.262125 master-0 kubenswrapper[4807]: I1014 13:21:42.262047 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:42.262882 master-0 kubenswrapper[4807]: E1014 13:21:42.262230 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:43.262495 master-0 kubenswrapper[4807]: I1014 13:21:43.262257 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:43.263552 master-0 kubenswrapper[4807]: E1014 13:21:43.262578 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:44.261821 master-0 kubenswrapper[4807]: I1014 13:21:44.261668 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:44.261821 master-0 kubenswrapper[4807]: E1014 13:21:44.261813 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:45.261429 master-0 kubenswrapper[4807]: I1014 13:21:45.261314 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:45.262252 master-0 kubenswrapper[4807]: E1014 13:21:45.261551 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:46.262429 master-0 kubenswrapper[4807]: I1014 13:21:46.262314 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:46.263291 master-0 kubenswrapper[4807]: E1014 13:21:46.262621 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:46.328994 master-0 kubenswrapper[4807]: I1014 13:21:46.328884 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-544bd"] Oct 14 13:21:46.329229 master-0 kubenswrapper[4807]: I1014 13:21:46.329190 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.333062 master-0 kubenswrapper[4807]: I1014 13:21:46.332986 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"node-resolver-dockercfg-9lm9q" Oct 14 13:21:46.333216 master-0 kubenswrapper[4807]: I1014 13:21:46.333067 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"openshift-service-ca.crt" Oct 14 13:21:46.337265 master-0 kubenswrapper[4807]: I1014 13:21:46.337174 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"kube-root-ca.crt" Oct 14 13:21:46.338259 master-0 kubenswrapper[4807]: I1014 13:21:46.337943 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-xsrn9"] Oct 14 13:21:46.340294 master-0 kubenswrapper[4807]: I1014 13:21:46.340234 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.343872 master-0 kubenswrapper[4807]: I1014 13:21:46.343806 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"kube-root-ca.crt" Oct 14 13:21:46.344208 master-0 kubenswrapper[4807]: I1014 13:21:46.344154 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"env-overrides" Oct 14 13:21:46.344731 master-0 kubenswrapper[4807]: I1014 13:21:46.344514 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Oct 14 13:21:46.345260 master-0 kubenswrapper[4807]: I1014 13:21:46.345196 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-config" Oct 14 13:21:46.345559 master-0 kubenswrapper[4807]: I1014 13:21:46.345448 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"openshift-service-ca.crt" Oct 14 13:21:46.345702 master-0 kubenswrapper[4807]: I1014 13:21:46.345592 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ovn-kubernetes"/"ovnkube-script-lib" Oct 14 13:21:46.348680 master-0 kubenswrapper[4807]: I1014 13:21:46.348629 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-kubernetes-node-dockercfg-hlhhv" Oct 14 13:21:46.359324 master-0 kubenswrapper[4807]: I1014 13:21:46.359268 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-vvmcs"] Oct 14 13:21:46.359640 master-0 kubenswrapper[4807]: I1014 13:21:46.359593 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.361959 master-0 kubenswrapper[4807]: I1014 13:21:46.361814 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"kube-root-ca.crt" Oct 14 13:21:46.362352 master-0 kubenswrapper[4807]: I1014 13:21:46.362282 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"tuned-dockercfg-n86t7" Oct 14 13:21:46.362922 master-0 kubenswrapper[4807]: I1014 13:21:46.362864 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-cluster-node-tuning-operator"/"openshift-service-ca.crt" Oct 14 13:21:46.365355 master-0 kubenswrapper[4807]: I1014 13:21:46.365297 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-bvr92"] Oct 14 13:21:46.365646 master-0 kubenswrapper[4807]: I1014 13:21:46.365591 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.366332 master-0 kubenswrapper[4807]: I1014 13:21:46.366263 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-node-identity/network-node-identity-lfw7t"] Oct 14 13:21:46.366694 master-0 kubenswrapper[4807]: I1014 13:21:46.366652 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-daemon-7q9jd"] Oct 14 13:21:46.367064 master-0 kubenswrapper[4807]: I1014 13:21:46.367025 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.367426 master-0 kubenswrapper[4807]: I1014 13:21:46.367021 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.368507 master-0 kubenswrapper[4807]: I1014 13:21:46.368378 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"cni-copy-resources" Oct 14 13:21:46.369557 master-0 kubenswrapper[4807]: I1014 13:21:46.369508 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"openshift-service-ca.crt" Oct 14 13:21:46.369679 master-0 kubenswrapper[4807]: I1014 13:21:46.369598 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"kube-root-ca.crt" Oct 14 13:21:46.370322 master-0 kubenswrapper[4807]: I1014 13:21:46.370261 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"multus-daemon-config" Oct 14 13:21:46.370454 master-0 kubenswrapper[4807]: I1014 13:21:46.370351 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-dockercfg-nrnqw" Oct 14 13:21:46.371007 master-0 kubenswrapper[4807]: I1014 13:21:46.370917 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-dzmh2"] Oct 14 13:21:46.371573 master-0 kubenswrapper[4807]: I1014 13:21:46.371515 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"env-overrides" Oct 14 13:21:46.371573 master-0 kubenswrapper[4807]: I1014 13:21:46.371568 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"ovnkube-identity-cm" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371584 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-rbac-proxy" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371609 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"openshift-service-ca.crt" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371612 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"openshift-service-ca.crt" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371647 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-machine-config-operator"/"kube-root-ca.crt" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371614 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371707 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"default-dockercfg-cxvsj" Oct 14 13:21:46.371915 master-0 kubenswrapper[4807]: I1014 13:21:46.371614 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Oct 14 13:21:46.373088 master-0 kubenswrapper[4807]: I1014 13:21:46.371981 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-j2xzg" Oct 14 13:21:46.373088 master-0 kubenswrapper[4807]: I1014 13:21:46.372061 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.373088 master-0 kubenswrapper[4807]: I1014 13:21:46.372153 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-node-identity"/"kube-root-ca.crt" Oct 14 13:21:46.374960 master-0 kubenswrapper[4807]: I1014 13:21:46.374899 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"default-cni-sysctl-allowlist" Oct 14 13:21:46.375564 master-0 kubenswrapper[4807]: I1014 13:21:46.375498 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ancillary-tools-dockercfg-x97tr" Oct 14 13:21:46.375828 master-0 kubenswrapper[4807]: I1014 13:21:46.375762 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-multus"/"whereabouts-config" Oct 14 13:21:46.392779 master-0 kubenswrapper[4807]: I1014 13:21:46.392715 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.392779 master-0 kubenswrapper[4807]: I1014 13:21:46.392766 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.393047 master-0 kubenswrapper[4807]: I1014 13:21:46.392790 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-run\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.393047 master-0 kubenswrapper[4807]: I1014 13:21:46.392818 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-etc-kubernetes\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393047 master-0 kubenswrapper[4807]: I1014 13:21:46.392919 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-netns\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.393320 master-0 kubenswrapper[4807]: I1014 13:21:46.393037 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-sys\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.393320 master-0 kubenswrapper[4807]: I1014 13:21:46.393125 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-etc-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.393320 master-0 kubenswrapper[4807]: I1014 13:21:46.393206 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-daemon-config\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393320 master-0 kubenswrapper[4807]: I1014 13:21:46.393252 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fad033-37b3-421e-ade0-a5d12b9c602a-webhook-cert\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.393320 master-0 kubenswrapper[4807]: I1014 13:21:46.393310 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-k8s-cni-cncf-io\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393356 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq5ns\" (UniqueName: \"kubernetes.io/projected/edfc4a81-3d91-4a5c-930a-bab333ced974-kube-api-access-vq5ns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393397 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-cni-binary-copy\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393437 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-tuned\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393506 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-hostroot\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393550 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-mcd-auth-proxy-config\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393588 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-kubernetes\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393621 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-conf\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.393668 master-0 kubenswrapper[4807]: I1014 13:21:46.393657 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-var-lib-kubelet\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393741 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-env-overrides\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393803 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7stc\" (UniqueName: \"kubernetes.io/projected/8b7e285d-eb25-409b-9d12-ad9cb384768e-kube-api-access-q7stc\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393847 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-proxy-tls\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393896 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-cnibin\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393945 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9nbx\" (UniqueName: \"kubernetes.io/projected/21fad033-37b3-421e-ade0-a5d12b9c602a-kube-api-access-k9nbx\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.393987 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cmcg\" (UniqueName: \"kubernetes.io/projected/66c6c65d-9df0-443f-88dc-1d0036767317-kube-api-access-7cmcg\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394028 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-ovn\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394061 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-node-log\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394097 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-system-cni-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394129 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-multus\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394176 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394219 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-bin\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394301 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-modprobe-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.394342 master-0 kubenswrapper[4807]: I1014 13:21:46.394352 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-system-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394386 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-os-release\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394517 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-multus-certs\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394589 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-ovnkube-identity-cm\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394642 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-var-lib-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394677 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-env-overrides\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394711 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-script-lib\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394746 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-cnibin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394780 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-kubelet\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394814 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-conf-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394849 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-whereabouts-configmap\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394890 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvkbq\" (UniqueName: \"kubernetes.io/projected/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-kube-api-access-qvkbq\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394927 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6p8d\" (UniqueName: \"kubernetes.io/projected/5e794951-e28c-4305-a38b-00f1d5c9942f-kube-api-access-n6p8d\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394962 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-lib-modules\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.394993 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89jjl\" (UniqueName: \"kubernetes.io/projected/0cd3e127-6da9-4369-8760-6b49bd63fac3-kube-api-access-89jjl\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.395026 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-rootfs\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.395512 master-0 kubenswrapper[4807]: I1014 13:21:46.395062 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-slash\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395119 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-netd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395216 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysconfig\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395251 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-systemd\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395284 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-tmp\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395380 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b7e285d-eb25-409b-9d12-ad9cb384768e-hosts-file\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395437 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395512 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-kubelet\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395547 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-systemd-units\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395581 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-systemd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395620 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e794951-e28c-4305-a38b-00f1d5c9942f-ovn-node-metrics-cert\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395671 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395727 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-bin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395824 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-log-socket\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395869 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-config\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395935 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-socket-dir-parent\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.395995 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-netns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.396771 master-0 kubenswrapper[4807]: I1014 13:21:46.396084 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-os-release\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.398046 master-0 kubenswrapper[4807]: I1014 13:21:46.396133 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.398046 master-0 kubenswrapper[4807]: I1014 13:21:46.396168 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.398046 master-0 kubenswrapper[4807]: I1014 13:21:46.396200 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.398046 master-0 kubenswrapper[4807]: I1014 13:21:46.396236 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-host\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.484143 master-0 kubenswrapper[4807]: I1014 13:21:46.484017 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gww4z"] Oct 14 13:21:46.484767 master-0 kubenswrapper[4807]: I1014 13:21:46.484722 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.487362 master-0 kubenswrapper[4807]: W1014 13:21:46.487258 4807 reflector.go:561] object-"openshift-monitoring"/"node-exporter-dockercfg-fk8vl": failed to list *v1.Secret: secrets "node-exporter-dockercfg-fk8vl" is forbidden: User "system:node:master-0" cannot list resource "secrets" in API group "" in the namespace "openshift-monitoring": no relationship found between node 'master-0' and this object Oct 14 13:21:46.487497 master-0 kubenswrapper[4807]: E1014 13:21:46.487369 4807 reflector.go:158] "Unhandled Error" err="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fk8vl\": Failed to watch *v1.Secret: failed to list *v1.Secret: secrets \"node-exporter-dockercfg-fk8vl\" is forbidden: User \"system:node:master-0\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'master-0' and this object" logger="UnhandledError" Oct 14 13:21:46.487743 master-0 kubenswrapper[4807]: I1014 13:21:46.487687 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Oct 14 13:21:46.487822 master-0 kubenswrapper[4807]: I1014 13:21:46.487684 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Oct 14 13:21:46.488280 master-0 kubenswrapper[4807]: I1014 13:21:46.488219 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"openshift-service-ca.crt" Oct 14 13:21:46.488489 master-0 kubenswrapper[4807]: I1014 13:21:46.488391 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-client-ca" Oct 14 13:21:46.488680 master-0 kubenswrapper[4807]: I1014 13:21:46.488624 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kube-root-ca.crt" Oct 14 13:21:46.497070 master-0 kubenswrapper[4807]: I1014 13:21:46.496983 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497203 master-0 kubenswrapper[4807]: I1014 13:21:46.497078 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-run\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.497203 master-0 kubenswrapper[4807]: I1014 13:21:46.497143 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-etc-kubernetes\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497192 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497201 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-netns\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497270 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-run\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497311 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497313 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-netns\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497372 master-0 kubenswrapper[4807]: I1014 13:21:46.497279 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-etc-kubernetes\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497386 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-etc-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497431 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-sys\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497348 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497515 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-etc-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497519 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-daemon-config\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497623 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fad033-37b3-421e-ade0-a5d12b9c602a-webhook-cert\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497634 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-sys\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497664 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vq5ns\" (UniqueName: \"kubernetes.io/projected/edfc4a81-3d91-4a5c-930a-bab333ced974-kube-api-access-vq5ns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497705 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-cni-binary-copy\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.497745 master-0 kubenswrapper[4807]: I1014 13:21:46.497738 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-k8s-cni-cncf-io\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.498369 master-0 kubenswrapper[4807]: I1014 13:21:46.497771 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-hostroot\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.498369 master-0 kubenswrapper[4807]: I1014 13:21:46.497808 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-mcd-auth-proxy-config\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.498369 master-0 kubenswrapper[4807]: I1014 13:21:46.497846 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-k8s-cni-cncf-io\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.498369 master-0 kubenswrapper[4807]: I1014 13:21:46.497965 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-hostroot\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498423 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-tuned\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498498 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-conf\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498536 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-var-lib-kubelet\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498562 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-env-overrides\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498588 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-q7stc\" (UniqueName: \"kubernetes.io/projected/8b7e285d-eb25-409b-9d12-ad9cb384768e-kube-api-access-q7stc\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498613 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-kubernetes\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498638 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-cnibin\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.498728 master-0 kubenswrapper[4807]: I1014 13:21:46.498742 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-k9nbx\" (UniqueName: \"kubernetes.io/projected/21fad033-37b3-421e-ade0-a5d12b9c602a-kube-api-access-k9nbx\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498777 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-proxy-tls\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498802 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-ovn\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498830 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-node-log\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498854 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-system-cni-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498881 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cmcg\" (UniqueName: \"kubernetes.io/projected/66c6c65d-9df0-443f-88dc-1d0036767317-kube-api-access-7cmcg\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498909 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498947 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-multus\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498952 4807 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.498975 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-modprobe-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499002 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-system-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499026 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-os-release\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499051 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-multus-certs\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499078 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-ovnkube-identity-cm\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499109 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-bin\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499133 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-env-overrides\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499159 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-script-lib\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499187 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-cnibin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.499358 master-0 kubenswrapper[4807]: I1014 13:21:46.499217 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-kubelet\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499230 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"mcd-auth-proxy-config\" (UniqueName: \"kubernetes.io/configmap/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-mcd-auth-proxy-config\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499236 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-cni-binary-copy\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499282 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-conf-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499244 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-conf-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499227 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-kubernetes\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499294 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-multus-certs\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499374 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-cnibin\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499415 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-kubelet\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.500746 master-0 kubenswrapper[4807]: I1014 13:21:46.499358 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-ovn\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.499081 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-daemon-config\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501188 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-var-lib-kubelet\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501205 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-cnibin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501586 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-system-cni-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501728 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-modprobe-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501743 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-env-overrides\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501820 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-os-release\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.501982 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-multus\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502014 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-bin\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502188 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-system-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.499437 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-node-log\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502392 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-whereabouts-configmap\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502559 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-binary-copy\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502583 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-var-lib-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502586 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-conf\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502695 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n6p8d\" (UniqueName: \"kubernetes.io/projected/5e794951-e28c-4305-a38b-00f1d5c9942f-kube-api-access-n6p8d\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502754 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-lib-modules\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.504600 master-0 kubenswrapper[4807]: I1014 13:21:46.502825 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-var-lib-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.502959 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-89jjl\" (UniqueName: \"kubernetes.io/projected/0cd3e127-6da9-4369-8760-6b49bd63fac3-kube-api-access-89jjl\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503051 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-rootfs\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503090 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-identity-cm\" (UniqueName: \"kubernetes.io/configmap/21fad033-37b3-421e-ade0-a5d12b9c602a-ovnkube-identity-cm\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503199 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qvkbq\" (UniqueName: \"kubernetes.io/projected/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-kube-api-access-qvkbq\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503262 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-netd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503273 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-lib-modules\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503363 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysconfig\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503485 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"whereabouts-configmap\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-whereabouts-configmap\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503564 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysconfig\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503632 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-systemd\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503662 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-tmp\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503759 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b7e285d-eb25-409b-9d12-ad9cb384768e-hosts-file\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503798 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-slash\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503795 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-env-overrides\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503832 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-kubelet\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503868 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-systemd-units\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505272 master-0 kubenswrapper[4807]: I1014 13:21:46.503924 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-systemd-units\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.503938 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-cni-netd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.503949 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8b7e285d-eb25-409b-9d12-ad9cb384768e-hosts-file\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.503973 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-slash\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.504020 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-systemd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.504031 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-host-kubelet\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.504049 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-script-lib\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.505897 master-0 kubenswrapper[4807]: I1014 13:21:46.504106 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e794951-e28c-4305-a38b-00f1d5c9942f-ovn-node-metrics-cert\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.506452 master-0 kubenswrapper[4807]: I1014 13:21:46.504172 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rootfs\" (UniqueName: \"kubernetes.io/host-path/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-rootfs\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.506540 master-0 kubenswrapper[4807]: I1014 13:21:46.504195 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-systemd\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.506581 master-0 kubenswrapper[4807]: I1014 13:21:46.504261 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-systemd\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.506581 master-0 kubenswrapper[4807]: I1014 13:21:46.504328 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.506704 master-0 kubenswrapper[4807]: I1014 13:21:46.506654 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-bin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.506742 master-0 kubenswrapper[4807]: I1014 13:21:46.504422 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-cni-dir\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.506837 master-0 kubenswrapper[4807]: I1014 13:21:46.506425 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-tuned\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.506877 master-0 kubenswrapper[4807]: I1014 13:21:46.506833 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.507128 master-0 kubenswrapper[4807]: I1014 13:21:46.506962 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-var-lib-cni-bin\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.507128 master-0 kubenswrapper[4807]: I1014 13:21:46.507012 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-log-socket\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.507128 master-0 kubenswrapper[4807]: I1014 13:21:46.506971 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-log-socket\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.507300 master-0 kubenswrapper[4807]: I1014 13:21:46.507260 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-config\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.507405 master-0 kubenswrapper[4807]: I1014 13:21:46.507370 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-socket-dir-parent\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.507482 master-0 kubenswrapper[4807]: I1014 13:21:46.507440 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-netns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.507740 master-0 kubenswrapper[4807]: I1014 13:21:46.507676 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-host-run-netns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.507937 master-0 kubenswrapper[4807]: I1014 13:21:46.507735 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.508133 master-0 kubenswrapper[4807]: I1014 13:21:46.508018 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.508215 master-0 kubenswrapper[4807]: I1014 13:21:46.508082 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-tls\" (UniqueName: \"kubernetes.io/secret/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-proxy-tls\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509522 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/edfc4a81-3d91-4a5c-930a-bab333ced974-multus-socket-dir-parent\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509492 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509398 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509516 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-etc-sysctl-d\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509677 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-host\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509689 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/66c6c65d-9df0-443f-88dc-1d0036767317-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509730 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-os-release\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509869 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/66c6c65d-9df0-443f-88dc-1d0036767317-os-release\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509938 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0cd3e127-6da9-4369-8760-6b49bd63fac3-host\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509974 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e794951-e28c-4305-a38b-00f1d5c9942f-run-openvswitch\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.509977 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/21fad033-37b3-421e-ade0-a5d12b9c602a-webhook-cert\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.510063 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e794951-e28c-4305-a38b-00f1d5c9942f-ovnkube-config\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.510274 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-4wx2z"] Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.510337 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e794951-e28c-4305-a38b-00f1d5c9942f-ovn-node-metrics-cert\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.510512 master-0 kubenswrapper[4807]: I1014 13:21:46.510367 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0cd3e127-6da9-4369-8760-6b49bd63fac3-tmp\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.511133 master-0 kubenswrapper[4807]: I1014 13:21:46.510853 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.511752 master-0 kubenswrapper[4807]: I1014 13:21:46.511684 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-vmk66"] Oct 14 13:21:46.512259 master-0 kubenswrapper[4807]: I1014 13:21:46.512216 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:46.512384 master-0 kubenswrapper[4807]: E1014 13:21:46.512337 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:46.512551 master-0 kubenswrapper[4807]: I1014 13:21:46.512430 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-p5vjv"] Oct 14 13:21:46.513232 master-0 kubenswrapper[4807]: I1014 13:21:46.513182 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.513373 master-0 kubenswrapper[4807]: E1014 13:21:46.513317 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:46.513889 master-0 kubenswrapper[4807]: I1014 13:21:46.513851 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"kube-root-ca.crt" Oct 14 13:21:46.517843 master-0 kubenswrapper[4807]: I1014 13:21:46.517806 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"openshift-service-ca.crt" Oct 14 13:21:46.518010 master-0 kubenswrapper[4807]: I1014 13:21:46.517935 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-image-registry"/"image-registry-certificates" Oct 14 13:21:46.518136 master-0 kubenswrapper[4807]: I1014 13:21:46.518082 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-svq88" Oct 14 13:21:46.531629 master-0 kubenswrapper[4807]: I1014 13:21:46.531564 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9nbx\" (UniqueName: \"kubernetes.io/projected/21fad033-37b3-421e-ade0-a5d12b9c602a-kube-api-access-k9nbx\") pod \"network-node-identity-lfw7t\" (UID: \"21fad033-37b3-421e-ade0-a5d12b9c602a\") " pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.534352 master-0 kubenswrapper[4807]: I1014 13:21:46.534285 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvkbq\" (UniqueName: \"kubernetes.io/projected/ba5baade-d195-4bd8-949c-3ac5d8b0acb2-kube-api-access-qvkbq\") pod \"machine-config-daemon-7q9jd\" (UID: \"ba5baade-d195-4bd8-949c-3ac5d8b0acb2\") " pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.535178 master-0 kubenswrapper[4807]: I1014 13:21:46.535132 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6p8d\" (UniqueName: \"kubernetes.io/projected/5e794951-e28c-4305-a38b-00f1d5c9942f-kube-api-access-n6p8d\") pod \"ovnkube-node-xsrn9\" (UID: \"5e794951-e28c-4305-a38b-00f1d5c9942f\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.536866 master-0 kubenswrapper[4807]: I1014 13:21:46.536826 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cmcg\" (UniqueName: \"kubernetes.io/projected/66c6c65d-9df0-443f-88dc-1d0036767317-kube-api-access-7cmcg\") pod \"multus-additional-cni-plugins-dzmh2\" (UID: \"66c6c65d-9df0-443f-88dc-1d0036767317\") " pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.543757 master-0 kubenswrapper[4807]: I1014 13:21:46.543710 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq5ns\" (UniqueName: \"kubernetes.io/projected/edfc4a81-3d91-4a5c-930a-bab333ced974-kube-api-access-vq5ns\") pod \"multus-bvr92\" (UID: \"edfc4a81-3d91-4a5c-930a-bab333ced974\") " pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.544086 master-0 kubenswrapper[4807]: I1014 13:21:46.544022 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-89jjl\" (UniqueName: \"kubernetes.io/projected/0cd3e127-6da9-4369-8760-6b49bd63fac3-kube-api-access-89jjl\") pod \"tuned-vvmcs\" (UID: \"0cd3e127-6da9-4369-8760-6b49bd63fac3\") " pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.547639 master-0 kubenswrapper[4807]: I1014 13:21:46.547592 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7stc\" (UniqueName: \"kubernetes.io/projected/8b7e285d-eb25-409b-9d12-ad9cb384768e-kube-api-access-q7stc\") pod \"node-resolver-544bd\" (UID: \"8b7e285d-eb25-409b-9d12-ad9cb384768e\") " pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.610193 master-0 kubenswrapper[4807]: I1014 13:21:46.610105 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:46.610193 master-0 kubenswrapper[4807]: I1014 13:21:46.610175 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq66q\" (UniqueName: \"kubernetes.io/projected/43d751fa-69e4-4205-b368-4aa3167a71a9-kube-api-access-bq66q\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.610534 master-0 kubenswrapper[4807]: I1014 13:21:46.610211 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-sys\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610534 master-0 kubenswrapper[4807]: I1014 13:21:46.610248 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-tls\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610534 master-0 kubenswrapper[4807]: I1014 13:21:46.610309 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.610534 master-0 kubenswrapper[4807]: I1014 13:21:46.610493 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c593965b-ba7b-477c-b906-0c57232dc126-serviceca\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.610705 master-0 kubenswrapper[4807]: I1014 13:21:46.610573 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-root\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610705 master-0 kubenswrapper[4807]: I1014 13:21:46.610602 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c593965b-ba7b-477c-b906-0c57232dc126-host\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.610705 master-0 kubenswrapper[4807]: I1014 13:21:46.610631 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl829\" (UniqueName: \"kubernetes.io/projected/c593965b-ba7b-477c-b906-0c57232dc126-kube-api-access-jl829\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.610705 master-0 kubenswrapper[4807]: I1014 13:21:46.610655 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24a8ebe-d871-438b-b267-24dd4b994ce6-metrics-client-ca\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610705 master-0 kubenswrapper[4807]: I1014 13:21:46.610712 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-textfile\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610903 master-0 kubenswrapper[4807]: I1014 13:21:46.610735 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfjwp\" (UniqueName: \"kubernetes.io/projected/a24a8ebe-d871-438b-b267-24dd4b994ce6-kube-api-access-bfjwp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610903 master-0 kubenswrapper[4807]: I1014 13:21:46.610818 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-wtmp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.610903 master-0 kubenswrapper[4807]: I1014 13:21:46.610835 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.660216 master-0 kubenswrapper[4807]: I1014 13:21:46.660103 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-544bd" Oct 14 13:21:46.680753 master-0 kubenswrapper[4807]: I1014 13:21:46.680693 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:21:46.693510 master-0 kubenswrapper[4807]: I1014 13:21:46.693432 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" Oct 14 13:21:46.694544 master-0 kubenswrapper[4807]: W1014 13:21:46.694003 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e794951_e28c_4305_a38b_00f1d5c9942f.slice/crio-c17225bd2a1e93f5a831a66b7105c51ea62cfc639171def1bcb91289e874807a WatchSource:0}: Error finding container c17225bd2a1e93f5a831a66b7105c51ea62cfc639171def1bcb91289e874807a: Status 404 returned error can't find the container with id c17225bd2a1e93f5a831a66b7105c51ea62cfc639171def1bcb91289e874807a Oct 14 13:21:46.708730 master-0 kubenswrapper[4807]: I1014 13:21:46.708652 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bvr92" Oct 14 13:21:46.709077 master-0 kubenswrapper[4807]: W1014 13:21:46.709019 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd3e127_6da9_4369_8760_6b49bd63fac3.slice/crio-1256c4af5b717845c2fb3b84f66ada3807bab9112b41a573dbd590cff775da64 WatchSource:0}: Error finding container 1256c4af5b717845c2fb3b84f66ada3807bab9112b41a573dbd590cff775da64: Status 404 returned error can't find the container with id 1256c4af5b717845c2fb3b84f66ada3807bab9112b41a573dbd590cff775da64 Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711117 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-textfile\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711171 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bfjwp\" (UniqueName: \"kubernetes.io/projected/a24a8ebe-d871-438b-b267-24dd4b994ce6-kube-api-access-bfjwp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711266 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-wtmp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711291 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711321 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711345 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bq66q\" (UniqueName: \"kubernetes.io/projected/43d751fa-69e4-4205-b368-4aa3167a71a9-kube-api-access-bq66q\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711374 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-sys\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711437 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-tls\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711482 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711515 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c593965b-ba7b-477c-b906-0c57232dc126-serviceca\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711578 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-root\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711589 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-textfile\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711604 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c593965b-ba7b-477c-b906-0c57232dc126-host\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.711769 master-0 kubenswrapper[4807]: I1014 13:21:46.711648 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c593965b-ba7b-477c-b906-0c57232dc126-host\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: I1014 13:21:46.712438 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-wtmp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: I1014 13:21:46.713588 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-jl829\" (UniqueName: \"kubernetes.io/projected/c593965b-ba7b-477c-b906-0c57232dc126-kube-api-access-jl829\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: I1014 13:21:46.713648 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-sys\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: I1014 13:21:46.713664 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24a8ebe-d871-438b-b267-24dd4b994ce6-metrics-client-ca\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: E1014 13:21:46.714261 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: E1014 13:21:46.714367 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:47.21433416 +0000 UTC m=+101.895635984 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:46.714773 master-0 kubenswrapper[4807]: I1014 13:21:46.714376 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a24a8ebe-d871-438b-b267-24dd4b994ce6-root\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.717020 master-0 kubenswrapper[4807]: I1014 13:21:46.715378 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a24a8ebe-d871-438b-b267-24dd4b994ce6-metrics-client-ca\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.717020 master-0 kubenswrapper[4807]: I1014 13:21:46.715434 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c593965b-ba7b-477c-b906-0c57232dc126-serviceca\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.717020 master-0 kubenswrapper[4807]: I1014 13:21:46.716281 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" Oct 14 13:21:46.718841 master-0 kubenswrapper[4807]: I1014 13:21:46.718781 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.720407 master-0 kubenswrapper[4807]: I1014 13:21:46.719975 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a24a8ebe-d871-438b-b267-24dd4b994ce6-node-exporter-tls\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.724681 master-0 kubenswrapper[4807]: I1014 13:21:46.724622 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-node-identity/network-node-identity-lfw7t" Oct 14 13:21:46.728202 master-0 kubenswrapper[4807]: W1014 13:21:46.728137 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedfc4a81_3d91_4a5c_930a_bab333ced974.slice/crio-096a59947d07759e4412e35c87b119915f41fe89c085109d047f3769ff07829a WatchSource:0}: Error finding container 096a59947d07759e4412e35c87b119915f41fe89c085109d047f3769ff07829a: Status 404 returned error can't find the container with id 096a59947d07759e4412e35c87b119915f41fe89c085109d047f3769ff07829a Oct 14 13:21:46.733621 master-0 kubenswrapper[4807]: I1014 13:21:46.732582 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" Oct 14 13:21:46.737405 master-0 kubenswrapper[4807]: I1014 13:21:46.737336 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq66q\" (UniqueName: \"kubernetes.io/projected/43d751fa-69e4-4205-b368-4aa3167a71a9-kube-api-access-bq66q\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:46.738435 master-0 kubenswrapper[4807]: I1014 13:21:46.738361 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl829\" (UniqueName: \"kubernetes.io/projected/c593965b-ba7b-477c-b906-0c57232dc126-kube-api-access-jl829\") pod \"node-ca-4wx2z\" (UID: \"c593965b-ba7b-477c-b906-0c57232dc126\") " pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.740144 master-0 kubenswrapper[4807]: I1014 13:21:46.740069 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfjwp\" (UniqueName: \"kubernetes.io/projected/a24a8ebe-d871-438b-b267-24dd4b994ce6-kube-api-access-bfjwp\") pod \"node-exporter-gww4z\" (UID: \"a24a8ebe-d871-438b-b267-24dd4b994ce6\") " pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:46.742306 master-0 kubenswrapper[4807]: W1014 13:21:46.742253 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5baade_d195_4bd8_949c_3ac5d8b0acb2.slice/crio-2fe3e61c34b82dad86f3f06ad10f40b7cd014d38d279a9168aa06458f184d306 WatchSource:0}: Error finding container 2fe3e61c34b82dad86f3f06ad10f40b7cd014d38d279a9168aa06458f184d306: Status 404 returned error can't find the container with id 2fe3e61c34b82dad86f3f06ad10f40b7cd014d38d279a9168aa06458f184d306 Oct 14 13:21:46.749575 master-0 kubenswrapper[4807]: E1014 13:21:46.749515 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:21:46.749575 master-0 kubenswrapper[4807]: E1014 13:21:46.749562 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:21:46.749575 master-0 kubenswrapper[4807]: E1014 13:21:46.749582 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:46.749807 master-0 kubenswrapper[4807]: E1014 13:21:46.749670 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:47.249641859 +0000 UTC m=+101.930943703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:46.750963 master-0 kubenswrapper[4807]: W1014 13:21:46.750691 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fad033_37b3_421e_ade0_a5d12b9c602a.slice/crio-dce30acc5e61785a8385c037ce7d48db46dd09adcbd1dcecb78b7cdf49f42a5d WatchSource:0}: Error finding container dce30acc5e61785a8385c037ce7d48db46dd09adcbd1dcecb78b7cdf49f42a5d: Status 404 returned error can't find the container with id dce30acc5e61785a8385c037ce7d48db46dd09adcbd1dcecb78b7cdf49f42a5d Oct 14 13:21:46.752129 master-0 kubenswrapper[4807]: W1014 13:21:46.752063 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c6c65d_9df0_443f_88dc_1d0036767317.slice/crio-2d0004dfb9a65aa6b79d24c9e9d475e96ca3966ca401b2ce7c6965faf7755c4a WatchSource:0}: Error finding container 2d0004dfb9a65aa6b79d24c9e9d475e96ca3966ca401b2ce7c6965faf7755c4a: Status 404 returned error can't find the container with id 2d0004dfb9a65aa6b79d24c9e9d475e96ca3966ca401b2ce7c6965faf7755c4a Oct 14 13:21:46.847925 master-0 kubenswrapper[4807]: I1014 13:21:46.847829 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4wx2z" Oct 14 13:21:46.864290 master-0 kubenswrapper[4807]: W1014 13:21:46.864196 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc593965b_ba7b_477c_b906_0c57232dc126.slice/crio-c11e09c4798281b482904d8e55f13e379a3b48ad4aa33ab19a94bcd620af8e60 WatchSource:0}: Error finding container c11e09c4798281b482904d8e55f13e379a3b48ad4aa33ab19a94bcd620af8e60: Status 404 returned error can't find the container with id c11e09c4798281b482904d8e55f13e379a3b48ad4aa33ab19a94bcd620af8e60 Oct 14 13:21:47.220672 master-0 kubenswrapper[4807]: I1014 13:21:47.220068 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:47.220672 master-0 kubenswrapper[4807]: E1014 13:21:47.220438 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:47.221032 master-0 kubenswrapper[4807]: E1014 13:21:47.220726 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:48.220703714 +0000 UTC m=+102.902005538 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:47.261530 master-0 kubenswrapper[4807]: I1014 13:21:47.261488 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:47.261741 master-0 kubenswrapper[4807]: E1014 13:21:47.261589 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:47.321992 master-0 kubenswrapper[4807]: I1014 13:21:47.321933 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:47.323287 master-0 kubenswrapper[4807]: E1014 13:21:47.322398 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:21:47.323287 master-0 kubenswrapper[4807]: E1014 13:21:47.322443 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:21:47.323287 master-0 kubenswrapper[4807]: E1014 13:21:47.322482 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:47.323287 master-0 kubenswrapper[4807]: E1014 13:21:47.322562 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:48.322538417 +0000 UTC m=+103.003840251 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:47.516183 master-0 kubenswrapper[4807]: I1014 13:21:47.516132 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lfw7t" event={"ID":"21fad033-37b3-421e-ade0-a5d12b9c602a","Type":"ContainerStarted","Data":"dce30acc5e61785a8385c037ce7d48db46dd09adcbd1dcecb78b7cdf49f42a5d"} Oct 14 13:21:47.518332 master-0 kubenswrapper[4807]: I1014 13:21:47.518282 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" event={"ID":"ba5baade-d195-4bd8-949c-3ac5d8b0acb2","Type":"ContainerStarted","Data":"c451bb1012895d208aa01666e0a8a41ef7be7d34945e29488cbfd7e4f9bcd1ad"} Oct 14 13:21:47.518412 master-0 kubenswrapper[4807]: I1014 13:21:47.518357 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" event={"ID":"ba5baade-d195-4bd8-949c-3ac5d8b0acb2","Type":"ContainerStarted","Data":"1df568ef271041f43baf01bdc48c1aa00694a520b063a00e26c94ddc22e1a53d"} Oct 14 13:21:47.518412 master-0 kubenswrapper[4807]: I1014 13:21:47.518370 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" event={"ID":"ba5baade-d195-4bd8-949c-3ac5d8b0acb2","Type":"ContainerStarted","Data":"2fe3e61c34b82dad86f3f06ad10f40b7cd014d38d279a9168aa06458f184d306"} Oct 14 13:21:47.520065 master-0 kubenswrapper[4807]: I1014 13:21:47.520036 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvr92" event={"ID":"edfc4a81-3d91-4a5c-930a-bab333ced974","Type":"ContainerStarted","Data":"096a59947d07759e4412e35c87b119915f41fe89c085109d047f3769ff07829a"} Oct 14 13:21:47.521132 master-0 kubenswrapper[4807]: I1014 13:21:47.521086 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-544bd" event={"ID":"8b7e285d-eb25-409b-9d12-ad9cb384768e","Type":"ContainerStarted","Data":"80ff5d7e4a3a111b0710abd74c3b6cb5618435fa89453e2b9957a9e2b32ea1e4"} Oct 14 13:21:47.522406 master-0 kubenswrapper[4807]: I1014 13:21:47.522360 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerStarted","Data":"2d0004dfb9a65aa6b79d24c9e9d475e96ca3966ca401b2ce7c6965faf7755c4a"} Oct 14 13:21:47.525013 master-0 kubenswrapper[4807]: I1014 13:21:47.524963 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" event={"ID":"0cd3e127-6da9-4369-8760-6b49bd63fac3","Type":"ContainerStarted","Data":"1256c4af5b717845c2fb3b84f66ada3807bab9112b41a573dbd590cff775da64"} Oct 14 13:21:47.526127 master-0 kubenswrapper[4807]: I1014 13:21:47.526093 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"c17225bd2a1e93f5a831a66b7105c51ea62cfc639171def1bcb91289e874807a"} Oct 14 13:21:47.527520 master-0 kubenswrapper[4807]: I1014 13:21:47.527448 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wx2z" event={"ID":"c593965b-ba7b-477c-b906-0c57232dc126","Type":"ContainerStarted","Data":"c11e09c4798281b482904d8e55f13e379a3b48ad4aa33ab19a94bcd620af8e60"} Oct 14 13:21:47.803846 master-0 kubenswrapper[4807]: I1014 13:21:47.803710 4807 kubelet_pods.go:1000] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-monitoring/node-exporter-gww4z" secret="" err="failed to sync secret cache: timed out waiting for the condition" Oct 14 13:21:47.803846 master-0 kubenswrapper[4807]: I1014 13:21:47.803788 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gww4z" Oct 14 13:21:47.818357 master-0 kubenswrapper[4807]: W1014 13:21:47.818299 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24a8ebe_d871_438b_b267_24dd4b994ce6.slice/crio-b0e20c33b0e1492d5d456cad2be069634c56d3ab7d830a931d0941c2a230d8f8 WatchSource:0}: Error finding container b0e20c33b0e1492d5d456cad2be069634c56d3ab7d830a931d0941c2a230d8f8: Status 404 returned error can't find the container with id b0e20c33b0e1492d5d456cad2be069634c56d3ab7d830a931d0941c2a230d8f8 Oct 14 13:21:47.971057 master-0 kubenswrapper[4807]: I1014 13:21:47.971009 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-fk8vl" Oct 14 13:21:48.230324 master-0 kubenswrapper[4807]: I1014 13:21:48.230210 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:48.230583 master-0 kubenswrapper[4807]: E1014 13:21:48.230506 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:48.230690 master-0 kubenswrapper[4807]: E1014 13:21:48.230665 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:50.23063099 +0000 UTC m=+104.911932994 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: I1014 13:21:48.261690 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: I1014 13:21:48.261739 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: I1014 13:21:48.261786 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: E1014 13:21:48.261827 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: E1014 13:21:48.261914 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:48.282221 master-0 kubenswrapper[4807]: E1014 13:21:48.261980 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:48.331252 master-0 kubenswrapper[4807]: I1014 13:21:48.331194 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:48.331763 master-0 kubenswrapper[4807]: E1014 13:21:48.331412 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:21:48.331763 master-0 kubenswrapper[4807]: E1014 13:21:48.331441 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:21:48.331763 master-0 kubenswrapper[4807]: E1014 13:21:48.331469 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:48.331763 master-0 kubenswrapper[4807]: E1014 13:21:48.331529 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:50.331510749 +0000 UTC m=+105.012812573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:48.530608 master-0 kubenswrapper[4807]: I1014 13:21:48.530501 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gww4z" event={"ID":"a24a8ebe-d871-438b-b267-24dd4b994ce6","Type":"ContainerStarted","Data":"b0e20c33b0e1492d5d456cad2be069634c56d3ab7d830a931d0941c2a230d8f8"} Oct 14 13:21:49.261337 master-0 kubenswrapper[4807]: I1014 13:21:49.261284 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:49.261646 master-0 kubenswrapper[4807]: E1014 13:21:49.261427 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:50.247240 master-0 kubenswrapper[4807]: I1014 13:21:50.247153 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:50.248901 master-0 kubenswrapper[4807]: E1014 13:21:50.247323 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:50.248901 master-0 kubenswrapper[4807]: E1014 13:21:50.247381 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:54.247362564 +0000 UTC m=+108.928664388 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:50.261227 master-0 kubenswrapper[4807]: I1014 13:21:50.261174 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:50.261532 master-0 kubenswrapper[4807]: E1014 13:21:50.261266 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:50.261532 master-0 kubenswrapper[4807]: I1014 13:21:50.261317 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:50.261532 master-0 kubenswrapper[4807]: I1014 13:21:50.261341 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:50.261532 master-0 kubenswrapper[4807]: E1014 13:21:50.261361 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:50.261532 master-0 kubenswrapper[4807]: E1014 13:21:50.261412 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:50.348139 master-0 kubenswrapper[4807]: I1014 13:21:50.348077 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:50.348451 master-0 kubenswrapper[4807]: E1014 13:21:50.348322 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:21:50.348451 master-0 kubenswrapper[4807]: E1014 13:21:50.348359 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:21:50.348451 master-0 kubenswrapper[4807]: E1014 13:21:50.348373 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:50.348451 master-0 kubenswrapper[4807]: E1014 13:21:50.348435 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:54.348414738 +0000 UTC m=+109.029716572 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:51.261301 master-0 kubenswrapper[4807]: I1014 13:21:51.261243 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:51.262231 master-0 kubenswrapper[4807]: E1014 13:21:51.261385 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:52.262052 master-0 kubenswrapper[4807]: I1014 13:21:52.261716 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:52.263312 master-0 kubenswrapper[4807]: E1014 13:21:52.262138 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:52.263312 master-0 kubenswrapper[4807]: I1014 13:21:52.262966 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:52.263312 master-0 kubenswrapper[4807]: E1014 13:21:52.263075 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:52.263312 master-0 kubenswrapper[4807]: I1014 13:21:52.263205 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:52.263312 master-0 kubenswrapper[4807]: E1014 13:21:52.263272 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:53.261813 master-0 kubenswrapper[4807]: I1014 13:21:53.261753 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:53.262128 master-0 kubenswrapper[4807]: E1014 13:21:53.261897 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:54.261979 master-0 kubenswrapper[4807]: I1014 13:21:54.261849 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:54.261979 master-0 kubenswrapper[4807]: I1014 13:21:54.261879 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:54.262603 master-0 kubenswrapper[4807]: E1014 13:21:54.261996 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:54.262603 master-0 kubenswrapper[4807]: E1014 13:21:54.262482 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:54.262911 master-0 kubenswrapper[4807]: I1014 13:21:54.262746 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:54.262911 master-0 kubenswrapper[4807]: E1014 13:21:54.262859 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:54.283938 master-0 kubenswrapper[4807]: I1014 13:21:54.283877 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:54.284039 master-0 kubenswrapper[4807]: E1014 13:21:54.284022 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:54.284103 master-0 kubenswrapper[4807]: E1014 13:21:54.284071 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:02.284055664 +0000 UTC m=+116.965357488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:21:54.385209 master-0 kubenswrapper[4807]: I1014 13:21:54.385114 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:54.385551 master-0 kubenswrapper[4807]: E1014 13:21:54.385491 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:21:54.385551 master-0 kubenswrapper[4807]: E1014 13:21:54.385550 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:21:54.385665 master-0 kubenswrapper[4807]: E1014 13:21:54.385575 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:54.385708 master-0 kubenswrapper[4807]: E1014 13:21:54.385675 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:02.3856429 +0000 UTC m=+117.066944764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:21:55.070595 master-0 kubenswrapper[4807]: I1014 13:21:55.070500 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-daemon-7q9jd" podStartSLOduration=102.070479809 podStartE2EDuration="1m42.070479809s" podCreationTimestamp="2025-10-14 13:20:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:21:47.549762863 +0000 UTC m=+102.231064687" watchObservedRunningTime="2025-10-14 13:21:55.070479809 +0000 UTC m=+109.751781643" Oct 14 13:21:55.070990 master-0 kubenswrapper[4807]: I1014 13:21:55.070968 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-master-0"] Oct 14 13:21:55.071300 master-0 kubenswrapper[4807]: I1014 13:21:55.071277 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.071382 master-0 kubenswrapper[4807]: E1014 13:21:55.071354 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:21:55.193998 master-0 kubenswrapper[4807]: I1014 13:21:55.193788 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.193998 master-0 kubenswrapper[4807]: I1014 13:21:55.193852 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.261438 master-0 kubenswrapper[4807]: I1014 13:21:55.261392 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:55.261661 master-0 kubenswrapper[4807]: E1014 13:21:55.261610 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:55.295041 master-0 kubenswrapper[4807]: I1014 13:21:55.294669 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.295041 master-0 kubenswrapper[4807]: I1014 13:21:55.294712 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.295041 master-0 kubenswrapper[4807]: I1014 13:21:55.294859 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.311158 master-0 kubenswrapper[4807]: E1014 13:21:55.311099 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:55.311219 master-0 kubenswrapper[4807]: E1014 13:21:55.311160 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:55.311271 master-0 kubenswrapper[4807]: E1014 13:21:55.311250 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:55.811219149 +0000 UTC m=+110.492520973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:55.899822 master-0 kubenswrapper[4807]: I1014 13:21:55.899764 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:55.900092 master-0 kubenswrapper[4807]: E1014 13:21:55.900014 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:55.900092 master-0 kubenswrapper[4807]: E1014 13:21:55.900052 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:55.900345 master-0 kubenswrapper[4807]: E1014 13:21:55.900125 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:56.900105044 +0000 UTC m=+111.581406938 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:56.261664 master-0 kubenswrapper[4807]: I1014 13:21:56.261542 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:56.261664 master-0 kubenswrapper[4807]: I1014 13:21:56.261542 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:56.261664 master-0 kubenswrapper[4807]: I1014 13:21:56.261593 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:56.261664 master-0 kubenswrapper[4807]: I1014 13:21:56.261561 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:56.262149 master-0 kubenswrapper[4807]: E1014 13:21:56.262088 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:56.262212 master-0 kubenswrapper[4807]: E1014 13:21:56.262174 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:21:56.262279 master-0 kubenswrapper[4807]: E1014 13:21:56.262255 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:56.262440 master-0 kubenswrapper[4807]: E1014 13:21:56.262396 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:56.910673 master-0 kubenswrapper[4807]: I1014 13:21:56.910595 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:56.911605 master-0 kubenswrapper[4807]: E1014 13:21:56.910769 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:56.911605 master-0 kubenswrapper[4807]: E1014 13:21:56.910788 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:56.911605 master-0 kubenswrapper[4807]: E1014 13:21:56.910843 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:58.910823901 +0000 UTC m=+113.592125725 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:57.262204 master-0 kubenswrapper[4807]: I1014 13:21:57.262021 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:57.262204 master-0 kubenswrapper[4807]: E1014 13:21:57.262170 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:57.270558 master-0 kubenswrapper[4807]: I1014 13:21:57.270494 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/installer-6-master-0"] Oct 14 13:21:57.270996 master-0 kubenswrapper[4807]: I1014 13:21:57.270970 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.271064 master-0 kubenswrapper[4807]: E1014 13:21:57.271014 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:21:57.414227 master-0 kubenswrapper[4807]: I1014 13:21:57.414150 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.414227 master-0 kubenswrapper[4807]: I1014 13:21:57.414203 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.414543 master-0 kubenswrapper[4807]: I1014 13:21:57.414298 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.515791 master-0 kubenswrapper[4807]: I1014 13:21:57.515591 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.515791 master-0 kubenswrapper[4807]: I1014 13:21:57.515680 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.515791 master-0 kubenswrapper[4807]: I1014 13:21:57.515704 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.515791 master-0 kubenswrapper[4807]: I1014 13:21:57.515784 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.516311 master-0 kubenswrapper[4807]: I1014 13:21:57.515892 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:57.531752 master-0 kubenswrapper[4807]: E1014 13:21:57.531663 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:57.531752 master-0 kubenswrapper[4807]: E1014 13:21:57.531717 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:57.531752 master-0 kubenswrapper[4807]: E1014 13:21:57.531789 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:58.031765203 +0000 UTC m=+112.713067067 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.122189 master-0 kubenswrapper[4807]: I1014 13:21:58.122134 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:58.122734 master-0 kubenswrapper[4807]: E1014 13:21:58.122316 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.122734 master-0 kubenswrapper[4807]: E1014 13:21:58.122335 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.122734 master-0 kubenswrapper[4807]: E1014 13:21:58.122390 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:21:59.122372281 +0000 UTC m=+113.803674115 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.261947 master-0 kubenswrapper[4807]: I1014 13:21:58.261847 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:58.261947 master-0 kubenswrapper[4807]: I1014 13:21:58.261919 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: I1014 13:21:58.261972 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: I1014 13:21:58.261993 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: E1014 13:21:58.262039 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: E1014 13:21:58.262115 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: E1014 13:21:58.262190 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:21:58.262276 master-0 kubenswrapper[4807]: E1014 13:21:58.262258 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:21:58.930386 master-0 kubenswrapper[4807]: I1014 13:21:58.930326 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:21:58.930657 master-0 kubenswrapper[4807]: E1014 13:21:58.930517 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.930657 master-0 kubenswrapper[4807]: E1014 13:21:58.930540 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:58.930657 master-0 kubenswrapper[4807]: E1014 13:21:58.930593 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:02.930575872 +0000 UTC m=+117.611877696 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:59.136836 master-0 kubenswrapper[4807]: I1014 13:21:59.136759 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:59.137552 master-0 kubenswrapper[4807]: E1014 13:21:59.136956 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:59.137552 master-0 kubenswrapper[4807]: E1014 13:21:59.136975 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:59.137552 master-0 kubenswrapper[4807]: E1014 13:21:59.137028 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:01.137011578 +0000 UTC m=+115.818313402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:21:59.261306 master-0 kubenswrapper[4807]: I1014 13:21:59.261180 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:21:59.261306 master-0 kubenswrapper[4807]: I1014 13:21:59.261238 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:21:59.261520 master-0 kubenswrapper[4807]: E1014 13:21:59.261308 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:21:59.261520 master-0 kubenswrapper[4807]: E1014 13:21:59.261386 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:00.261872 master-0 kubenswrapper[4807]: I1014 13:22:00.261800 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:00.261872 master-0 kubenswrapper[4807]: I1014 13:22:00.261847 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: I1014 13:22:00.261809 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: I1014 13:22:00.261980 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: E1014 13:22:00.262126 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: E1014 13:22:00.262293 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: E1014 13:22:00.262362 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:00.262676 master-0 kubenswrapper[4807]: E1014 13:22:00.262510 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:01.159884 master-0 kubenswrapper[4807]: I1014 13:22:01.159802 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:01.160149 master-0 kubenswrapper[4807]: E1014 13:22:01.159992 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:01.160149 master-0 kubenswrapper[4807]: E1014 13:22:01.160025 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:01.160149 master-0 kubenswrapper[4807]: E1014 13:22:01.160100 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:05.160074044 +0000 UTC m=+119.841375888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:01.261819 master-0 kubenswrapper[4807]: I1014 13:22:01.261746 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:01.262069 master-0 kubenswrapper[4807]: I1014 13:22:01.261845 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:01.262069 master-0 kubenswrapper[4807]: E1014 13:22:01.261900 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:01.262069 master-0 kubenswrapper[4807]: E1014 13:22:01.262021 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:02.262053 master-0 kubenswrapper[4807]: I1014 13:22:02.261978 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:02.262053 master-0 kubenswrapper[4807]: I1014 13:22:02.262043 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:02.262935 master-0 kubenswrapper[4807]: I1014 13:22:02.262070 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:02.262935 master-0 kubenswrapper[4807]: E1014 13:22:02.262116 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:02.262935 master-0 kubenswrapper[4807]: E1014 13:22:02.262192 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:02.262935 master-0 kubenswrapper[4807]: E1014 13:22:02.262275 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:02.263655 master-0 kubenswrapper[4807]: I1014 13:22:02.263374 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:02.263655 master-0 kubenswrapper[4807]: E1014 13:22:02.263588 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:02.371757 master-0 kubenswrapper[4807]: I1014 13:22:02.371664 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:02.372103 master-0 kubenswrapper[4807]: E1014 13:22:02.371922 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:22:02.372103 master-0 kubenswrapper[4807]: E1014 13:22:02.371993 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:18.371971302 +0000 UTC m=+133.053273146 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:22:02.472961 master-0 kubenswrapper[4807]: I1014 13:22:02.472865 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:02.473311 master-0 kubenswrapper[4807]: E1014 13:22:02.473048 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:22:02.473311 master-0 kubenswrapper[4807]: E1014 13:22:02.473065 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:22:02.473311 master-0 kubenswrapper[4807]: E1014 13:22:02.473077 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:22:02.473311 master-0 kubenswrapper[4807]: E1014 13:22:02.473129 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:18.473114428 +0000 UTC m=+133.154416252 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:22:02.977533 master-0 kubenswrapper[4807]: I1014 13:22:02.977424 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:02.977774 master-0 kubenswrapper[4807]: E1014 13:22:02.977720 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:02.977837 master-0 kubenswrapper[4807]: E1014 13:22:02.977773 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:02.977890 master-0 kubenswrapper[4807]: E1014 13:22:02.977865 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:10.97783636 +0000 UTC m=+125.659138214 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:03.262188 master-0 kubenswrapper[4807]: I1014 13:22:03.262094 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:03.262905 master-0 kubenswrapper[4807]: I1014 13:22:03.262094 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:03.262905 master-0 kubenswrapper[4807]: E1014 13:22:03.262293 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:03.262905 master-0 kubenswrapper[4807]: E1014 13:22:03.262346 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:04.261303 master-0 kubenswrapper[4807]: I1014 13:22:04.261185 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:04.261303 master-0 kubenswrapper[4807]: I1014 13:22:04.261261 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:04.261680 master-0 kubenswrapper[4807]: I1014 13:22:04.261197 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:04.261680 master-0 kubenswrapper[4807]: E1014 13:22:04.261346 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:04.261680 master-0 kubenswrapper[4807]: E1014 13:22:04.261539 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:04.261680 master-0 kubenswrapper[4807]: I1014 13:22:04.261634 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:04.261945 master-0 kubenswrapper[4807]: E1014 13:22:04.261745 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:04.261945 master-0 kubenswrapper[4807]: E1014 13:22:04.261883 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:04.584765 master-0 kubenswrapper[4807]: I1014 13:22:04.584574 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lfw7t" event={"ID":"21fad033-37b3-421e-ade0-a5d12b9c602a","Type":"ContainerStarted","Data":"b98226258634fad40d23ff703ac440e082d73742765fbf4c3c1e4c1b2b9b500a"} Oct 14 13:22:04.584765 master-0 kubenswrapper[4807]: I1014 13:22:04.584683 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-node-identity/network-node-identity-lfw7t" event={"ID":"21fad033-37b3-421e-ade0-a5d12b9c602a","Type":"ContainerStarted","Data":"216173342defadac8bdbb26568ffb54c20793dfd8b76c53e9d8f80596fa7fd4f"} Oct 14 13:22:04.586503 master-0 kubenswrapper[4807]: I1014 13:22:04.586440 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" event={"ID":"0cd3e127-6da9-4369-8760-6b49bd63fac3","Type":"ContainerStarted","Data":"7f8c935f0dc35cffc432e5d97fdbc3c6dad0fcf238df1baffb1cf4a6850a7989"} Oct 14 13:22:04.588191 master-0 kubenswrapper[4807]: I1014 13:22:04.588126 4807 generic.go:334] "Generic (PLEG): container finished" podID="5e794951-e28c-4305-a38b-00f1d5c9942f" containerID="07bdd7e3e24686b2977b749bea68318d1876d79c53f50a35b9660659ee8b31c5" exitCode=0 Oct 14 13:22:04.588271 master-0 kubenswrapper[4807]: I1014 13:22:04.588230 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerDied","Data":"07bdd7e3e24686b2977b749bea68318d1876d79c53f50a35b9660659ee8b31c5"} Oct 14 13:22:04.589825 master-0 kubenswrapper[4807]: I1014 13:22:04.589798 4807 generic.go:334] "Generic (PLEG): container finished" podID="a24a8ebe-d871-438b-b267-24dd4b994ce6" containerID="ee514bf3b06e642d10e54b06e26b5ca216e76b6569422b866ee65f149de87c04" exitCode=0 Oct 14 13:22:04.589923 master-0 kubenswrapper[4807]: I1014 13:22:04.589881 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gww4z" event={"ID":"a24a8ebe-d871-438b-b267-24dd4b994ce6","Type":"ContainerDied","Data":"ee514bf3b06e642d10e54b06e26b5ca216e76b6569422b866ee65f149de87c04"} Oct 14 13:22:04.591940 master-0 kubenswrapper[4807]: I1014 13:22:04.591835 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="1cd3a684b2cc929a8488058339b3852d0966295a50e7dccb9199709b177b377f" exitCode=0 Oct 14 13:22:04.592010 master-0 kubenswrapper[4807]: I1014 13:22:04.591921 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"1cd3a684b2cc929a8488058339b3852d0966295a50e7dccb9199709b177b377f"} Oct 14 13:22:04.593858 master-0 kubenswrapper[4807]: I1014 13:22:04.593804 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bvr92" event={"ID":"edfc4a81-3d91-4a5c-930a-bab333ced974","Type":"ContainerStarted","Data":"6f7d1d8f0101c800917d0dddaa74d90fe8fffd72450d51dfe55a5f259796af80"} Oct 14 13:22:04.596047 master-0 kubenswrapper[4807]: I1014 13:22:04.595986 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-544bd" event={"ID":"8b7e285d-eb25-409b-9d12-ad9cb384768e","Type":"ContainerStarted","Data":"cd7e3a88df25a52bdef05cc4a480f355bc58c480d4027226bb30f1323652c756"} Oct 14 13:22:04.597429 master-0 kubenswrapper[4807]: I1014 13:22:04.597377 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4wx2z" event={"ID":"c593965b-ba7b-477c-b906-0c57232dc126","Type":"ContainerStarted","Data":"d85789363af029709b2f7a7e6727744d1147d8d0ee33394ba6aedb6817e37616"} Oct 14 13:22:04.840796 master-0 kubenswrapper[4807]: I1014 13:22:04.839382 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-node-identity/network-node-identity-lfw7t" podStartSLOduration=96.069920869 podStartE2EDuration="1m52.839355882s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.756178736 +0000 UTC m=+101.437480570" lastFinishedPulling="2025-10-14 13:22:03.525613749 +0000 UTC m=+118.206915583" observedRunningTime="2025-10-14 13:22:04.774689795 +0000 UTC m=+119.455991629" watchObservedRunningTime="2025-10-14 13:22:04.839355882 +0000 UTC m=+119.520657726" Oct 14 13:22:04.912025 master-0 kubenswrapper[4807]: I1014 13:22:04.911956 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-544bd" podStartSLOduration=96.177068097 podStartE2EDuration="1m52.91193625s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.674855165 +0000 UTC m=+101.356157019" lastFinishedPulling="2025-10-14 13:22:03.409723318 +0000 UTC m=+118.091025172" observedRunningTime="2025-10-14 13:22:04.864591735 +0000 UTC m=+119.545893569" watchObservedRunningTime="2025-10-14 13:22:04.91193625 +0000 UTC m=+119.593238084" Oct 14 13:22:04.954444 master-0 kubenswrapper[4807]: I1014 13:22:04.954356 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vvmcs" podStartSLOduration=96.233015283 podStartE2EDuration="1m52.95432373s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.714538366 +0000 UTC m=+101.395840220" lastFinishedPulling="2025-10-14 13:22:03.435846813 +0000 UTC m=+118.117148667" observedRunningTime="2025-10-14 13:22:04.953127509 +0000 UTC m=+119.634429343" watchObservedRunningTime="2025-10-14 13:22:04.95432373 +0000 UTC m=+119.635625584" Oct 14 13:22:04.990447 master-0 kubenswrapper[4807]: I1014 13:22:04.990295 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-bvr92" podStartSLOduration=96.287172921 podStartE2EDuration="1m52.990258265s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.73239297 +0000 UTC m=+101.413694794" lastFinishedPulling="2025-10-14 13:22:03.435478314 +0000 UTC m=+118.116780138" observedRunningTime="2025-10-14 13:22:04.98809503 +0000 UTC m=+119.669396884" watchObservedRunningTime="2025-10-14 13:22:04.990258265 +0000 UTC m=+119.671560129" Oct 14 13:22:05.039838 master-0 kubenswrapper[4807]: I1014 13:22:05.039724 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4wx2z" podStartSLOduration=96.496707797 podStartE2EDuration="1m53.039694004s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.866734561 +0000 UTC m=+101.548036385" lastFinishedPulling="2025-10-14 13:22:03.409720768 +0000 UTC m=+118.091022592" observedRunningTime="2025-10-14 13:22:05.038984086 +0000 UTC m=+119.720285920" watchObservedRunningTime="2025-10-14 13:22:05.039694004 +0000 UTC m=+119.720995868" Oct 14 13:22:05.197116 master-0 kubenswrapper[4807]: I1014 13:22:05.197027 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:05.197402 master-0 kubenswrapper[4807]: E1014 13:22:05.197348 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:05.197483 master-0 kubenswrapper[4807]: E1014 13:22:05.197412 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:05.197563 master-0 kubenswrapper[4807]: E1014 13:22:05.197529 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:13.197497721 +0000 UTC m=+127.878799585 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:05.262105 master-0 kubenswrapper[4807]: I1014 13:22:05.262047 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:05.262566 master-0 kubenswrapper[4807]: I1014 13:22:05.262062 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:05.262683 master-0 kubenswrapper[4807]: E1014 13:22:05.262513 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:05.262774 master-0 kubenswrapper[4807]: E1014 13:22:05.262717 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605766 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"a70e238255e2ee7ac3f0a5d5daa42440e94f691014ad09fa2c39bc3ea404d3f5"} Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605819 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"49946d58c29b58eed5f642a0476eaaaed3721cc87f3d1a0ecd65628317da1909"} Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605832 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"9d1ea9e979327ca6e192dffbc3dcffebfc9036294d97018533bc4edd430f802b"} Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605845 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"24a9a43f9e0c171427fe8cc8eee0c8a45903856b43c7deef146fd07c539f2a2f"} Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605860 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"80442393ce4fdbf4d51690f9ebeceb62ac91aa4735d5eed383ebaf347361ea70"} Oct 14 13:22:05.605855 master-0 kubenswrapper[4807]: I1014 13:22:05.605873 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"f32781c30d91dc1c4745877a846de08121b88d78bb8892d922ee6f8a7ff04038"} Oct 14 13:22:05.608026 master-0 kubenswrapper[4807]: I1014 13:22:05.607987 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gww4z" event={"ID":"a24a8ebe-d871-438b-b267-24dd4b994ce6","Type":"ContainerStarted","Data":"f29d48e525939d93741bc1bee340e8c061bedb6c1987e7a6803c0771b70710dc"} Oct 14 13:22:05.608026 master-0 kubenswrapper[4807]: I1014 13:22:05.608019 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gww4z" event={"ID":"a24a8ebe-d871-438b-b267-24dd4b994ce6","Type":"ContainerStarted","Data":"6fa40b2e930caf007a6d28c1eac04b1248254bae1bfd766d3cbd729b97e8a460"} Oct 14 13:22:05.631827 master-0 kubenswrapper[4807]: I1014 13:22:05.631736 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gww4z" podStartSLOduration=97.987413974 podStartE2EDuration="1m53.631711418s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:47.822718473 +0000 UTC m=+102.504020297" lastFinishedPulling="2025-10-14 13:22:03.467015917 +0000 UTC m=+118.148317741" observedRunningTime="2025-10-14 13:22:05.629927082 +0000 UTC m=+120.311228916" watchObservedRunningTime="2025-10-14 13:22:05.631711418 +0000 UTC m=+120.313013272" Oct 14 13:22:06.227001 master-0 kubenswrapper[4807]: E1014 13:22:06.226941 4807 kubelet_node_status.go:497] "Node not becoming ready in time after startup" Oct 14 13:22:06.261726 master-0 kubenswrapper[4807]: I1014 13:22:06.261687 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:06.261879 master-0 kubenswrapper[4807]: I1014 13:22:06.261823 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:06.263710 master-0 kubenswrapper[4807]: E1014 13:22:06.263589 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:06.263710 master-0 kubenswrapper[4807]: I1014 13:22:06.263629 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:06.263948 master-0 kubenswrapper[4807]: E1014 13:22:06.263736 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:06.263948 master-0 kubenswrapper[4807]: I1014 13:22:06.263633 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:06.263948 master-0 kubenswrapper[4807]: E1014 13:22:06.263799 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:06.264199 master-0 kubenswrapper[4807]: E1014 13:22:06.263979 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:06.294317 master-0 kubenswrapper[4807]: E1014 13:22:06.294213 4807 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Oct 14 13:22:07.262381 master-0 kubenswrapper[4807]: I1014 13:22:07.261911 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:07.263259 master-0 kubenswrapper[4807]: I1014 13:22:07.261911 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:07.263259 master-0 kubenswrapper[4807]: E1014 13:22:07.262501 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:07.263259 master-0 kubenswrapper[4807]: E1014 13:22:07.262600 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:07.620552 master-0 kubenswrapper[4807]: I1014 13:22:07.620453 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"30553a23e1837d09fd0ce7def8ebb84d40865743432412e4e88baa082d9e394b"} Oct 14 13:22:08.261765 master-0 kubenswrapper[4807]: I1014 13:22:08.261680 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:08.261765 master-0 kubenswrapper[4807]: I1014 13:22:08.261700 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:08.262084 master-0 kubenswrapper[4807]: I1014 13:22:08.261828 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:08.262084 master-0 kubenswrapper[4807]: E1014 13:22:08.261931 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:08.262084 master-0 kubenswrapper[4807]: I1014 13:22:08.261998 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:08.262084 master-0 kubenswrapper[4807]: E1014 13:22:08.262051 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:08.262300 master-0 kubenswrapper[4807]: E1014 13:22:08.262214 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:08.262361 master-0 kubenswrapper[4807]: E1014 13:22:08.262310 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:08.628692 master-0 kubenswrapper[4807]: I1014 13:22:08.628616 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:08.629957 master-0 kubenswrapper[4807]: E1014 13:22:08.628799 4807 projected.go:288] Couldn't get configMap openshift-etcd/kube-root-ca.crt: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:22:08.629957 master-0 kubenswrapper[4807]: E1014 13:22:08.628822 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-etcd/installer-8-master-0: object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:22:08.629957 master-0 kubenswrapper[4807]: E1014 13:22:08.628872 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access podName:51884012-8236-469c-8c63-49c36027fe7e nodeName:}" failed. No retries permitted until 2025-10-14 13:23:12.628854757 +0000 UTC m=+187.310156581 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access") pod "installer-8-master-0" (UID: "51884012-8236-469c-8c63-49c36027fe7e") : object "openshift-etcd"/"kube-root-ca.crt" not registered Oct 14 13:22:09.262141 master-0 kubenswrapper[4807]: I1014 13:22:09.262047 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:09.262526 master-0 kubenswrapper[4807]: E1014 13:22:09.262199 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:09.262526 master-0 kubenswrapper[4807]: I1014 13:22:09.262416 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:09.262526 master-0 kubenswrapper[4807]: E1014 13:22:09.262501 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:10.261708 master-0 kubenswrapper[4807]: I1014 13:22:10.261349 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: I1014 13:22:10.261377 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: E1014 13:22:10.261870 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: I1014 13:22:10.261430 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: I1014 13:22:10.261444 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: E1014 13:22:10.261961 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: E1014 13:22:10.262017 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:10.276017 master-0 kubenswrapper[4807]: E1014 13:22:10.262054 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:10.631355 master-0 kubenswrapper[4807]: I1014 13:22:10.631200 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="9009b5c436f2e557841ecf27d507d5ff79a280b79e02d08dc4b06062bf753a41" exitCode=0 Oct 14 13:22:10.631619 master-0 kubenswrapper[4807]: I1014 13:22:10.631429 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"9009b5c436f2e557841ecf27d507d5ff79a280b79e02d08dc4b06062bf753a41"} Oct 14 13:22:10.638152 master-0 kubenswrapper[4807]: I1014 13:22:10.638111 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" event={"ID":"5e794951-e28c-4305-a38b-00f1d5c9942f","Type":"ContainerStarted","Data":"3987d1f40848734a7ffad604a186a01bed31f264213be87ad5607c9927cb25d1"} Oct 14 13:22:10.638522 master-0 kubenswrapper[4807]: I1014 13:22:10.638494 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:10.720857 master-0 kubenswrapper[4807]: I1014 13:22:10.720701 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" podStartSLOduration=101.859418381 podStartE2EDuration="1m58.720673092s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.699134253 +0000 UTC m=+101.380436107" lastFinishedPulling="2025-10-14 13:22:03.560388984 +0000 UTC m=+118.241690818" observedRunningTime="2025-10-14 13:22:10.719600485 +0000 UTC m=+125.400902349" watchObservedRunningTime="2025-10-14 13:22:10.720673092 +0000 UTC m=+125.401974946" Oct 14 13:22:11.052761 master-0 kubenswrapper[4807]: I1014 13:22:11.052519 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:11.052761 master-0 kubenswrapper[4807]: E1014 13:22:11.052742 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:11.053039 master-0 kubenswrapper[4807]: E1014 13:22:11.052795 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/revision-pruner-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:11.053039 master-0 kubenswrapper[4807]: E1014 13:22:11.052874 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access podName:034af977-7690-48d7-882e-d52571758295 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:27.05284867 +0000 UTC m=+141.734150504 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access") pod "revision-pruner-6-master-0" (UID: "034af977-7690-48d7-882e-d52571758295") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:11.261282 master-0 kubenswrapper[4807]: I1014 13:22:11.261189 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:11.262099 master-0 kubenswrapper[4807]: I1014 13:22:11.261205 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:11.262099 master-0 kubenswrapper[4807]: E1014 13:22:11.261415 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:11.262099 master-0 kubenswrapper[4807]: E1014 13:22:11.261572 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:11.296245 master-0 kubenswrapper[4807]: E1014 13:22:11.296150 4807 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Oct 14 13:22:11.640987 master-0 kubenswrapper[4807]: I1014 13:22:11.640932 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:11.641215 master-0 kubenswrapper[4807]: I1014 13:22:11.641009 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:12.261856 master-0 kubenswrapper[4807]: I1014 13:22:12.261757 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:12.261988 master-0 kubenswrapper[4807]: E1014 13:22:12.261904 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:12.262592 master-0 kubenswrapper[4807]: I1014 13:22:12.262545 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:12.262910 master-0 kubenswrapper[4807]: I1014 13:22:12.262616 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:12.262910 master-0 kubenswrapper[4807]: E1014 13:22:12.262752 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:12.262910 master-0 kubenswrapper[4807]: I1014 13:22:12.262845 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:12.262991 master-0 kubenswrapper[4807]: E1014 13:22:12.262913 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:12.262991 master-0 kubenswrapper[4807]: E1014 13:22:12.262957 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:12.579599 master-0 kubenswrapper[4807]: I1014 13:22:12.579423 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmk66"] Oct 14 13:22:12.615534 master-0 kubenswrapper[4807]: I1014 13:22:12.615420 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-8-master-0"] Oct 14 13:22:12.616628 master-0 kubenswrapper[4807]: I1014 13:22:12.616543 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-6-master-0"] Oct 14 13:22:12.616736 master-0 kubenswrapper[4807]: I1014 13:22:12.616671 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:12.616848 master-0 kubenswrapper[4807]: E1014 13:22:12.616797 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:12.644417 master-0 kubenswrapper[4807]: I1014 13:22:12.644237 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-master-0"] Oct 14 13:22:12.647526 master-0 kubenswrapper[4807]: I1014 13:22:12.647454 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="b95801d73dd6d1ecf908ff2194bf0f702b7c8ebc4cfd29701067225bc41caf3b" exitCode=0 Oct 14 13:22:12.647761 master-0 kubenswrapper[4807]: I1014 13:22:12.647711 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"b95801d73dd6d1ecf908ff2194bf0f702b7c8ebc4cfd29701067225bc41caf3b"} Oct 14 13:22:12.647862 master-0 kubenswrapper[4807]: I1014 13:22:12.647727 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:12.647936 master-0 kubenswrapper[4807]: I1014 13:22:12.647874 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:12.648503 master-0 kubenswrapper[4807]: I1014 13:22:12.648421 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:12.648636 master-0 kubenswrapper[4807]: E1014 13:22:12.648592 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:12.649531 master-0 kubenswrapper[4807]: E1014 13:22:12.648738 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:12.649531 master-0 kubenswrapper[4807]: E1014 13:22:12.648947 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:12.734852 master-0 kubenswrapper[4807]: I1014 13:22:12.734669 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:22:12.735038 master-0 kubenswrapper[4807]: I1014 13:22:12.734988 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:12.735295 master-0 kubenswrapper[4807]: E1014 13:22:12.735235 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:12.735350 master-0 kubenswrapper[4807]: I1014 13:22:12.735272 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p5vjv"] Oct 14 13:22:12.735443 master-0 kubenswrapper[4807]: I1014 13:22:12.735416 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:12.735607 master-0 kubenswrapper[4807]: E1014 13:22:12.735569 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:13.273796 master-0 kubenswrapper[4807]: I1014 13:22:13.273667 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:13.275119 master-0 kubenswrapper[4807]: E1014 13:22:13.273907 4807 projected.go:288] Couldn't get configMap openshift-kube-scheduler/kube-root-ca.crt: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:13.275119 master-0 kubenswrapper[4807]: E1014 13:22:13.273946 4807 projected.go:194] Error preparing data for projected volume kube-api-access for pod openshift-kube-scheduler/installer-6-master-0: object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:13.275119 master-0 kubenswrapper[4807]: E1014 13:22:13.274023 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access podName:1e3b66b9-caf6-4445-b2b6-3117279ee481 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:29.273993899 +0000 UTC m=+143.955295723 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access" (UniqueName: "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access") pod "installer-6-master-0" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481") : object "openshift-kube-scheduler"/"kube-root-ca.crt" not registered Oct 14 13:22:14.261992 master-0 kubenswrapper[4807]: I1014 13:22:14.261598 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:14.262237 master-0 kubenswrapper[4807]: I1014 13:22:14.261663 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:14.262314 master-0 kubenswrapper[4807]: I1014 13:22:14.261719 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:14.262420 master-0 kubenswrapper[4807]: E1014 13:22:14.262345 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:14.262420 master-0 kubenswrapper[4807]: I1014 13:22:14.261780 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:14.262605 master-0 kubenswrapper[4807]: E1014 13:22:14.262430 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:14.262605 master-0 kubenswrapper[4807]: I1014 13:22:14.261813 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:14.262605 master-0 kubenswrapper[4807]: E1014 13:22:14.262554 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:14.262605 master-0 kubenswrapper[4807]: E1014 13:22:14.262092 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:14.262818 master-0 kubenswrapper[4807]: E1014 13:22:14.262626 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:14.262818 master-0 kubenswrapper[4807]: I1014 13:22:14.261788 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:14.262818 master-0 kubenswrapper[4807]: E1014 13:22:14.262746 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:14.660220 master-0 kubenswrapper[4807]: I1014 13:22:14.660111 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="1216e6fcceece790460eceaa5e8895b18b8210deda03f5351fa6d6ea7f873100" exitCode=0 Oct 14 13:22:14.660220 master-0 kubenswrapper[4807]: I1014 13:22:14.660190 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"1216e6fcceece790460eceaa5e8895b18b8210deda03f5351fa6d6ea7f873100"} Oct 14 13:22:16.261869 master-0 kubenswrapper[4807]: I1014 13:22:16.261767 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:16.261869 master-0 kubenswrapper[4807]: I1014 13:22:16.261815 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:16.261869 master-0 kubenswrapper[4807]: I1014 13:22:16.261772 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: I1014 13:22:16.262343 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262336 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: I1014 13:22:16.262388 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262495 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: I1014 13:22:16.262544 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262554 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262721 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262714 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:16.262935 master-0 kubenswrapper[4807]: E1014 13:22:16.262831 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:16.297028 master-0 kubenswrapper[4807]: E1014 13:22:16.296952 4807 kubelet.go:2916] "Container runtime network not ready" networkReady="NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" Oct 14 13:22:16.703731 master-0 kubenswrapper[4807]: I1014 13:22:16.703658 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:16.712308 master-0 kubenswrapper[4807]: I1014 13:22:16.712260 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:17.693762 master-0 kubenswrapper[4807]: I1014 13:22:17.693686 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsrn9" Oct 14 13:22:18.261577 master-0 kubenswrapper[4807]: I1014 13:22:18.261323 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:18.261577 master-0 kubenswrapper[4807]: I1014 13:22:18.261427 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:18.261913 master-0 kubenswrapper[4807]: I1014 13:22:18.261614 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:18.261913 master-0 kubenswrapper[4807]: I1014 13:22:18.261733 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:18.261913 master-0 kubenswrapper[4807]: E1014 13:22:18.261740 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:18.261913 master-0 kubenswrapper[4807]: I1014 13:22:18.261825 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:18.262125 master-0 kubenswrapper[4807]: E1014 13:22:18.261997 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:18.262125 master-0 kubenswrapper[4807]: I1014 13:22:18.262040 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:18.262294 master-0 kubenswrapper[4807]: E1014 13:22:18.262224 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:18.262432 master-0 kubenswrapper[4807]: E1014 13:22:18.262367 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:18.262544 master-0 kubenswrapper[4807]: E1014 13:22:18.262455 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:18.262605 master-0 kubenswrapper[4807]: E1014 13:22:18.262561 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:18.421884 master-0 kubenswrapper[4807]: I1014 13:22:18.421779 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:18.422142 master-0 kubenswrapper[4807]: E1014 13:22:18.421998 4807 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:22:18.422142 master-0 kubenswrapper[4807]: E1014 13:22:18.422104 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs podName:43d751fa-69e4-4205-b368-4aa3167a71a9 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:50.422074248 +0000 UTC m=+165.103376102 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs") pod "network-metrics-daemon-p5vjv" (UID: "43d751fa-69e4-4205-b368-4aa3167a71a9") : object "openshift-multus"/"metrics-daemon-secret" not registered Oct 14 13:22:18.523394 master-0 kubenswrapper[4807]: I1014 13:22:18.523197 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:18.523680 master-0 kubenswrapper[4807]: E1014 13:22:18.523515 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Oct 14 13:22:18.523680 master-0 kubenswrapper[4807]: E1014 13:22:18.523552 4807 projected.go:288] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Oct 14 13:22:18.523680 master-0 kubenswrapper[4807]: E1014 13:22:18.523575 4807 projected.go:194] Error preparing data for projected volume kube-api-access-kvcqq for pod openshift-network-diagnostics/network-check-target-vmk66: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:22:18.523680 master-0 kubenswrapper[4807]: E1014 13:22:18.523662 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq podName:65b2dcab-f199-48f6-9446-305c78399647 nodeName:}" failed. No retries permitted until 2025-10-14 13:22:50.523628384 +0000 UTC m=+165.204930238 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-kvcqq" (UniqueName: "kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq") pod "network-check-target-vmk66" (UID: "65b2dcab-f199-48f6-9446-305c78399647") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Oct 14 13:22:20.261675 master-0 kubenswrapper[4807]: I1014 13:22:20.261582 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:20.261675 master-0 kubenswrapper[4807]: I1014 13:22:20.261634 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:20.261675 master-0 kubenswrapper[4807]: I1014 13:22:20.261668 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: I1014 13:22:20.261690 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: I1014 13:22:20.261801 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: E1014 13:22:20.261801 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-vmk66" podUID="65b2dcab-f199-48f6-9446-305c78399647" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: I1014 13:22:20.261847 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: E1014 13:22:20.261973 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podUID="034af977-7690-48d7-882e-d52571758295" Oct 14 13:22:20.262512 master-0 kubenswrapper[4807]: E1014 13:22:20.262095 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" Oct 14 13:22:20.262775 master-0 kubenswrapper[4807]: E1014 13:22:20.262524 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-kube-scheduler/installer-6-master-0" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" Oct 14 13:22:20.262775 master-0 kubenswrapper[4807]: E1014 13:22:20.262600 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-p5vjv" podUID="43d751fa-69e4-4205-b368-4aa3167a71a9" Oct 14 13:22:20.262775 master-0 kubenswrapper[4807]: E1014 13:22:20.262681 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-etcd/installer-8-master-0" podUID="51884012-8236-469c-8c63-49c36027fe7e" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261226 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261286 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261295 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261313 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261352 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:22.261424 master-0 kubenswrapper[4807]: I1014 13:22:22.261381 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:22.263786 master-0 kubenswrapper[4807]: I1014 13:22:22.263746 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"installer-sa-dockercfg-sdwrm" Oct 14 13:22:22.264204 master-0 kubenswrapper[4807]: I1014 13:22:22.264174 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Oct 14 13:22:22.264370 master-0 kubenswrapper[4807]: I1014 13:22:22.264337 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"installer-sa-dockercfg-bm6wx" Oct 14 13:22:22.264635 master-0 kubenswrapper[4807]: I1014 13:22:22.264601 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"kube-root-ca.crt" Oct 14 13:22:22.264775 master-0 kubenswrapper[4807]: I1014 13:22:22.264733 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-sa-dockercfg-c42q9" Oct 14 13:22:22.264842 master-0 kubenswrapper[4807]: I1014 13:22:22.264770 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-diagnostics"/"openshift-service-ca.crt" Oct 14 13:22:22.265023 master-0 kubenswrapper[4807]: I1014 13:22:22.264988 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Oct 14 13:22:22.265132 master-0 kubenswrapper[4807]: I1014 13:22:22.265109 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Oct 14 13:22:22.265227 master-0 kubenswrapper[4807]: I1014 13:22:22.265209 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-xbs2c" Oct 14 13:22:22.265227 master-0 kubenswrapper[4807]: I1014 13:22:22.265212 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-diagnostics"/"default-dockercfg-ss7x7" Oct 14 13:22:22.265383 master-0 kubenswrapper[4807]: I1014 13:22:22.265355 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Oct 14 13:22:25.434308 master-0 kubenswrapper[4807]: I1014 13:22:25.434210 4807 kubelet_node_status.go:724] "Recording event message for node" node="master-0" event="NodeReady" Oct 14 13:22:26.702884 master-0 kubenswrapper[4807]: I1014 13:22:26.702245 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="da852a9035e64f8f6e88a96b33bd4193a0706ef1fb0288b7f67d5314c7b7cfb3" exitCode=0 Oct 14 13:22:26.703891 master-0 kubenswrapper[4807]: I1014 13:22:26.702329 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"da852a9035e64f8f6e88a96b33bd4193a0706ef1fb0288b7f67d5314c7b7cfb3"} Oct 14 13:22:27.117057 master-0 kubenswrapper[4807]: I1014 13:22:27.116917 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:27.126044 master-0 kubenswrapper[4807]: I1014 13:22:27.125935 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:27.406234 master-0 kubenswrapper[4807]: I1014 13:22:27.406136 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:27.633208 master-0 kubenswrapper[4807]: I1014 13:22:27.632750 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-authentication/oauth-openshift-65687bc9c8-w9j4s"] Oct 14 13:22:27.633556 master-0 kubenswrapper[4807]: I1014 13:22:27.633257 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.634537 master-0 kubenswrapper[4807]: I1014 13:22:27.634367 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6"] Oct 14 13:22:27.636080 master-0 kubenswrapper[4807]: I1014 13:22:27.635999 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.636431 master-0 kubenswrapper[4807]: I1014 13:22:27.636382 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt"] Oct 14 13:22:27.638451 master-0 kubenswrapper[4807]: I1014 13:22:27.638389 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.640269 master-0 kubenswrapper[4807]: I1014 13:22:27.640211 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-service-ca" Oct 14 13:22:27.640745 master-0 kubenswrapper[4807]: I1014 13:22:27.640652 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-t6l59" Oct 14 13:22:27.640825 master-0 kubenswrapper[4807]: I1014 13:22:27.640760 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Oct 14 13:22:27.640948 master-0 kubenswrapper[4807]: I1014 13:22:27.640702 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.644070 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"config" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.644332 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.644735 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"audit" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.644910 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-5vqgl" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645040 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645131 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"client-ca" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645272 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"kube-root-ca.crt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645417 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"config" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645423 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-cliconfig" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645534 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"client-ca" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645632 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645723 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"openshift-service-ca.crt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645767 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.645732 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.646077 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"openshift-service-ca.crt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.646122 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-route-controller-manager"/"kube-root-ca.crt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.646315 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-2zbrt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.646335 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-service-ca.crt" Oct 14 13:22:27.646684 master-0 kubenswrapper[4807]: I1014 13:22:27.646425 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"kube-root-ca.crt" Oct 14 13:22:27.648201 master-0 kubenswrapper[4807]: I1014 13:22:27.648101 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Oct 14 13:22:27.659474 master-0 kubenswrapper[4807]: I1014 13:22:27.659402 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-controller-manager"/"openshift-global-ca" Oct 14 13:22:27.662252 master-0 kubenswrapper[4807]: I1014 13:22:27.662190 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-authentication"/"v4-0-config-system-trusted-ca-bundle" Oct 14 13:22:27.671338 master-0 kubenswrapper[4807]: I1014 13:22:27.671282 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Oct 14 13:22:27.714389 master-0 kubenswrapper[4807]: I1014 13:22:27.714308 4807 generic.go:334] "Generic (PLEG): container finished" podID="66c6c65d-9df0-443f-88dc-1d0036767317" containerID="bf9afda8814ab6db47c1c9927b05a44e2d828bbe78f24358dbc910918e31d785" exitCode=0 Oct 14 13:22:27.714389 master-0 kubenswrapper[4807]: I1014 13:22:27.714380 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerDied","Data":"bf9afda8814ab6db47c1c9927b05a44e2d828bbe78f24358dbc910918e31d785"} Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725408 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-policies\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725503 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725580 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725618 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-config\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725676 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725734 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-dir\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725816 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725853 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-client-ca\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725908 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-client-ca\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.725940 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b857c24-2a3f-4f27-9182-3b5a228e8d75-serving-cert\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.726049 master-0 kubenswrapper[4807]: I1014 13:22:27.726000 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726432 master-0 kubenswrapper[4807]: I1014 13:22:27.726034 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9719f0e3-e762-4faf-83f4-f63fa9b966c7-serving-cert\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.726432 master-0 kubenswrapper[4807]: I1014 13:22:27.726101 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kll9s\" (UniqueName: \"kubernetes.io/projected/9719f0e3-e762-4faf-83f4-f63fa9b966c7-kube-api-access-kll9s\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.726432 master-0 kubenswrapper[4807]: I1014 13:22:27.726172 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-session\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726432 master-0 kubenswrapper[4807]: I1014 13:22:27.726241 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-config\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.726610 master-0 kubenswrapper[4807]: I1014 13:22:27.726519 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726708 master-0 kubenswrapper[4807]: I1014 13:22:27.726653 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hx8d\" (UniqueName: \"kubernetes.io/projected/5b857c24-2a3f-4f27-9182-3b5a228e8d75-kube-api-access-2hx8d\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.726766 master-0 kubenswrapper[4807]: I1014 13:22:27.726735 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2t86\" (UniqueName: \"kubernetes.io/projected/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-kube-api-access-j2t86\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.726923 master-0 kubenswrapper[4807]: I1014 13:22:27.726887 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-proxy-ca-bundles\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.727045 master-0 kubenswrapper[4807]: I1014 13:22:27.726944 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-login\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.727151 master-0 kubenswrapper[4807]: I1014 13:22:27.727118 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-error\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.727222 master-0 kubenswrapper[4807]: I1014 13:22:27.727197 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.828747 master-0 kubenswrapper[4807]: I1014 13:22:27.828563 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kll9s\" (UniqueName: \"kubernetes.io/projected/9719f0e3-e762-4faf-83f4-f63fa9b966c7-kube-api-access-kll9s\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.828747 master-0 kubenswrapper[4807]: I1014 13:22:27.828651 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-session\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.828747 master-0 kubenswrapper[4807]: I1014 13:22:27.828707 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-config\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828783 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828841 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2hx8d\" (UniqueName: \"kubernetes.io/projected/5b857c24-2a3f-4f27-9182-3b5a228e8d75-kube-api-access-2hx8d\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828882 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j2t86\" (UniqueName: \"kubernetes.io/projected/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-kube-api-access-j2t86\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828908 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828936 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-proxy-ca-bundles\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828962 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-login\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.828997 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-error\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829034 master-0 kubenswrapper[4807]: I1014 13:22:27.829042 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829093 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-policies\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829119 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829145 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829175 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-config\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829205 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829267 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-dir\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829314 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829348 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-client-ca\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829375 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-client-ca\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829400 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b857c24-2a3f-4f27-9182-3b5a228e8d75-serving-cert\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.829423 master-0 kubenswrapper[4807]: I1014 13:22:27.829426 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.830013 master-0 kubenswrapper[4807]: I1014 13:22:27.829452 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9719f0e3-e762-4faf-83f4-f63fa9b966c7-serving-cert\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.830580 master-0 kubenswrapper[4807]: I1014 13:22:27.830343 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-dir\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.830580 master-0 kubenswrapper[4807]: I1014 13:22:27.830392 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-service-ca\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.831432 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-cliconfig\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-cliconfig\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.831546 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-client-ca\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.831661 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-audit-policies\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.831760 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9719f0e3-e762-4faf-83f4-f63fa9b966c7-config\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.832116 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proxy-ca-bundles\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-proxy-ca-bundles\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.832831 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-client-ca\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.832938 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9719f0e3-e762-4faf-83f4-f63fa9b966c7-serving-cert\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.833098 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5b857c24-2a3f-4f27-9182-3b5a228e8d75-config\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.833165 master-0 kubenswrapper[4807]: I1014 13:22:27.833112 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-serving-cert\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.833719 master-0 kubenswrapper[4807]: I1014 13:22:27.833667 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-trusted-ca-bundle\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.833780 master-0 kubenswrapper[4807]: I1014 13:22:27.833724 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-session\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-session\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.834308 master-0 kubenswrapper[4807]: I1014 13:22:27.834255 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-router-certs\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-router-certs\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.835504 master-0 kubenswrapper[4807]: I1014 13:22:27.835429 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"installer-5-master-0\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:27.835692 master-0 kubenswrapper[4807]: I1014 13:22:27.835641 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-error\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-error\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.836156 master-0 kubenswrapper[4807]: I1014 13:22:27.836106 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-login\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-login\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.837035 master-0 kubenswrapper[4807]: I1014 13:22:27.836962 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5b857c24-2a3f-4f27-9182-3b5a228e8d75-serving-cert\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:27.838036 master-0 kubenswrapper[4807]: I1014 13:22:27.837967 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-user-template-provider-selection\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-user-template-provider-selection\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.838098 master-0 kubenswrapper[4807]: I1014 13:22:27.838038 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"v4-0-config-system-ocp-branding-template\" (UniqueName: \"kubernetes.io/secret/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-v4-0-config-system-ocp-branding-template\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:27.988047 master-0 kubenswrapper[4807]: I1014 13:22:27.987948 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:28.137944 master-0 kubenswrapper[4807]: I1014 13:22:28.136992 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt"] Oct 14 13:22:28.502919 master-0 kubenswrapper[4807]: I1014 13:22:28.502651 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6"] Oct 14 13:22:28.504000 master-0 kubenswrapper[4807]: I1014 13:22:28.503938 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-65687bc9c8-w9j4s"] Oct 14 13:22:28.726211 master-0 kubenswrapper[4807]: I1014 13:22:28.726036 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" event={"ID":"66c6c65d-9df0-443f-88dc-1d0036767317","Type":"ContainerStarted","Data":"f5e9c68d8523f38bccaa2d86469e92e63315e204e45b0a81fbbc68f93a58015a"} Oct 14 13:22:29.349337 master-0 kubenswrapper[4807]: I1014 13:22:29.349275 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/revision-pruner-6-master-0"] Oct 14 13:22:29.350383 master-0 kubenswrapper[4807]: I1014 13:22:29.349940 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:29.355436 master-0 kubenswrapper[4807]: I1014 13:22:29.355383 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"installer-6-master-0\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:29.356148 master-0 kubenswrapper[4807]: W1014 13:22:29.356031 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod034af977_7690_48d7_882e_d52571758295.slice/crio-ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181 WatchSource:0}: Error finding container ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181: Status 404 returned error can't find the container with id ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181 Oct 14 13:22:29.478800 master-0 kubenswrapper[4807]: I1014 13:22:29.478670 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:22:29.730779 master-0 kubenswrapper[4807]: I1014 13:22:29.730601 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-master-0" event={"ID":"034af977-7690-48d7-882e-d52571758295","Type":"ContainerStarted","Data":"ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181"} Oct 14 13:22:29.906325 master-0 kubenswrapper[4807]: I1014 13:22:29.906163 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/machine-config-server-xcgtf"] Oct 14 13:22:29.906810 master-0 kubenswrapper[4807]: I1014 13:22:29.906775 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:29.909789 master-0 kubenswrapper[4807]: I1014 13:22:29.909746 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-xxth4" Oct 14 13:22:29.910023 master-0 kubenswrapper[4807]: I1014 13:22:29.909932 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Oct 14 13:22:29.910510 master-0 kubenswrapper[4807]: I1014 13:22:29.910415 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Oct 14 13:22:30.026876 master-0 kubenswrapper[4807]: I1014 13:22:30.026795 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fkqvb"] Oct 14 13:22:30.027556 master-0 kubenswrapper[4807]: I1014 13:22:30.027505 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.032583 master-0 kubenswrapper[4807]: I1014 13:22:30.032532 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-fslmn" Oct 14 13:22:30.032742 master-0 kubenswrapper[4807]: I1014 13:22:30.032693 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"openshift-service-ca.crt" Oct 14 13:22:30.033035 master-0 kubenswrapper[4807]: I1014 13:22:30.032986 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-ingress-canary"/"kube-root-ca.crt" Oct 14 13:22:30.033184 master-0 kubenswrapper[4807]: I1014 13:22:30.033136 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Oct 14 13:22:30.058499 master-0 kubenswrapper[4807]: I1014 13:22:30.058371 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-node-bootstrap-token\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.058499 master-0 kubenswrapper[4807]: I1014 13:22:30.058493 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hml66\" (UniqueName: \"kubernetes.io/projected/84347f61-07ad-4b46-80aa-c1039536accf-kube-api-access-hml66\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.059001 master-0 kubenswrapper[4807]: I1014 13:22:30.058551 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-certs\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.159603 master-0 kubenswrapper[4807]: I1014 13:22:30.159443 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-cert\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.159603 master-0 kubenswrapper[4807]: I1014 13:22:30.159550 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-node-bootstrap-token\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.159603 master-0 kubenswrapper[4807]: I1014 13:22:30.159587 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hml66\" (UniqueName: \"kubernetes.io/projected/84347f61-07ad-4b46-80aa-c1039536accf-kube-api-access-hml66\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.159603 master-0 kubenswrapper[4807]: I1014 13:22:30.159610 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"certs\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-certs\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.159847 master-0 kubenswrapper[4807]: I1014 13:22:30.159640 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhhhn\" (UniqueName: \"kubernetes.io/projected/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-kube-api-access-lhhhn\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.163277 master-0 kubenswrapper[4807]: I1014 13:22:30.163221 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-bootstrap-token\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-node-bootstrap-token\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.164572 master-0 kubenswrapper[4807]: I1014 13:22:30.164514 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"certs\" (UniqueName: \"kubernetes.io/secret/84347f61-07ad-4b46-80aa-c1039536accf-certs\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:30.260850 master-0 kubenswrapper[4807]: I1014 13:22:30.260543 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-cert\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.260850 master-0 kubenswrapper[4807]: I1014 13:22:30.260685 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lhhhn\" (UniqueName: \"kubernetes.io/projected/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-kube-api-access-lhhhn\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.266749 master-0 kubenswrapper[4807]: I1014 13:22:30.266696 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-cert\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:30.535976 master-0 kubenswrapper[4807]: I1014 13:22:30.535803 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2t86\" (UniqueName: \"kubernetes.io/projected/c7fda5b1-b0b4-4499-98c4-db254f06d4bf-kube-api-access-j2t86\") pod \"oauth-openshift-65687bc9c8-w9j4s\" (UID: \"c7fda5b1-b0b4-4499-98c4-db254f06d4bf\") " pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:30.638889 master-0 kubenswrapper[4807]: I1014 13:22:30.638749 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkqvb"] Oct 14 13:22:30.658102 master-0 kubenswrapper[4807]: I1014 13:22:30.658010 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:31.272561 master-0 kubenswrapper[4807]: I1014 13:22:31.272498 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:22:31.542258 master-0 kubenswrapper[4807]: I1014 13:22:31.542044 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kll9s\" (UniqueName: \"kubernetes.io/projected/9719f0e3-e762-4faf-83f4-f63fa9b966c7-kube-api-access-kll9s\") pod \"route-controller-manager-7968c6c999-tlxv6\" (UID: \"9719f0e3-e762-4faf-83f4-f63fa9b966c7\") " pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:31.556567 master-0 kubenswrapper[4807]: I1014 13:22:31.556412 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hx8d\" (UniqueName: \"kubernetes.io/projected/5b857c24-2a3f-4f27-9182-3b5a228e8d75-kube-api-access-2hx8d\") pod \"controller-manager-78c5d9fccd-5xwlt\" (UID: \"5b857c24-2a3f-4f27-9182-3b5a228e8d75\") " pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:31.576262 master-0 kubenswrapper[4807]: I1014 13:22:31.576151 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:31.586995 master-0 kubenswrapper[4807]: I1014 13:22:31.586914 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:31.814092 master-0 kubenswrapper[4807]: I1014 13:22:31.813943 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/installer-6-master-0"] Oct 14 13:22:31.818361 master-0 kubenswrapper[4807]: I1014 13:22:31.818284 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6qp6p"] Oct 14 13:22:31.819154 master-0 kubenswrapper[4807]: I1014 13:22:31.819112 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.861942 master-0 kubenswrapper[4807]: I1014 13:22:31.825895 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hml66\" (UniqueName: \"kubernetes.io/projected/84347f61-07ad-4b46-80aa-c1039536accf-kube-api-access-hml66\") pod \"machine-config-server-xcgtf\" (UID: \"84347f61-07ad-4b46-80aa-c1039536accf\") " pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:31.861942 master-0 kubenswrapper[4807]: I1014 13:22:31.854718 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Oct 14 13:22:31.861942 master-0 kubenswrapper[4807]: I1014 13:22:31.855041 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-dns"/"dns-default" Oct 14 13:22:31.861942 master-0 kubenswrapper[4807]: I1014 13:22:31.855502 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-dockercfg-cf2b7" Oct 14 13:22:31.861942 master-0 kubenswrapper[4807]: I1014 13:22:31.858875 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhhhn\" (UniqueName: \"kubernetes.io/projected/c5db64cb-0ab9-4fd2-a09e-9070aa2976e4-kube-api-access-lhhhn\") pod \"ingress-canary-fkqvb\" (UID: \"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4\") " pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:31.888584 master-0 kubenswrapper[4807]: I1014 13:22:31.888495 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-hkmb5"] Oct 14 13:22:31.889232 master-0 kubenswrapper[4807]: I1014 13:22:31.889198 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qp6p"] Oct 14 13:22:31.889376 master-0 kubenswrapper[4807]: I1014 13:22:31.889349 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:31.891412 master-0 kubenswrapper[4807]: I1014 13:22:31.891370 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"iptables-alerter-script" Oct 14 13:22:31.891700 master-0 kubenswrapper[4807]: I1014 13:22:31.891664 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"iptables-alerter-dockercfg-hkq8s" Oct 14 13:22:31.891933 master-0 kubenswrapper[4807]: I1014 13:22:31.891866 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"openshift-service-ca.crt" Oct 14 13:22:31.892956 master-0 kubenswrapper[4807]: I1014 13:22:31.892661 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-network-operator"/"kube-root-ca.crt" Oct 14 13:22:31.898065 master-0 kubenswrapper[4807]: I1014 13:22:31.897993 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07a860df-b531-4eb6-a7a8-4f34c08b4c53-config-volume\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.898065 master-0 kubenswrapper[4807]: I1014 13:22:31.898046 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-925lc\" (UniqueName: \"kubernetes.io/projected/07a860df-b531-4eb6-a7a8-4f34c08b4c53-kube-api-access-925lc\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.898227 master-0 kubenswrapper[4807]: I1014 13:22:31.898197 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07a860df-b531-4eb6-a7a8-4f34c08b4c53-metrics-tls\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.951835 master-0 kubenswrapper[4807]: I1014 13:22:31.951772 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:22:31.998668 master-0 kubenswrapper[4807]: I1014 13:22:31.998634 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d52bee-f5ab-4466-97c1-033f1a7ae732-host-slash\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:31.998743 master-0 kubenswrapper[4807]: I1014 13:22:31.998682 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmj5p\" (UniqueName: \"kubernetes.io/projected/b5d52bee-f5ab-4466-97c1-033f1a7ae732-kube-api-access-kmj5p\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:31.998743 master-0 kubenswrapper[4807]: I1014 13:22:31.998718 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07a860df-b531-4eb6-a7a8-4f34c08b4c53-config-volume\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.998803 master-0 kubenswrapper[4807]: I1014 13:22:31.998748 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-925lc\" (UniqueName: \"kubernetes.io/projected/07a860df-b531-4eb6-a7a8-4f34c08b4c53-kube-api-access-925lc\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.998949 master-0 kubenswrapper[4807]: I1014 13:22:31.998900 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5d52bee-f5ab-4466-97c1-033f1a7ae732-iptables-alerter-script\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:31.999002 master-0 kubenswrapper[4807]: I1014 13:22:31.998974 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07a860df-b531-4eb6-a7a8-4f34c08b4c53-metrics-tls\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:31.999987 master-0 kubenswrapper[4807]: I1014 13:22:31.999956 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/07a860df-b531-4eb6-a7a8-4f34c08b4c53-config-volume\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:32.003218 master-0 kubenswrapper[4807]: I1014 13:22:32.003190 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/07a860df-b531-4eb6-a7a8-4f34c08b4c53-metrics-tls\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:32.060859 master-0 kubenswrapper[4807]: I1014 13:22:32.060787 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/machine-config-server-xcgtf" Oct 14 13:22:32.085058 master-0 kubenswrapper[4807]: W1014 13:22:32.084999 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84347f61_07ad_4b46_80aa_c1039536accf.slice/crio-972827555ca45ed702efb7104b7f310a873a1c21b6ebba1d15ed218525d6575e WatchSource:0}: Error finding container 972827555ca45ed702efb7104b7f310a873a1c21b6ebba1d15ed218525d6575e: Status 404 returned error can't find the container with id 972827555ca45ed702efb7104b7f310a873a1c21b6ebba1d15ed218525d6575e Oct 14 13:22:32.087346 master-0 kubenswrapper[4807]: I1014 13:22:32.087299 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-925lc\" (UniqueName: \"kubernetes.io/projected/07a860df-b531-4eb6-a7a8-4f34c08b4c53-kube-api-access-925lc\") pod \"dns-default-6qp6p\" (UID: \"07a860df-b531-4eb6-a7a8-4f34c08b4c53\") " pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:32.099726 master-0 kubenswrapper[4807]: I1014 13:22:32.099676 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5d52bee-f5ab-4466-97c1-033f1a7ae732-iptables-alerter-script\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.099834 master-0 kubenswrapper[4807]: I1014 13:22:32.099771 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d52bee-f5ab-4466-97c1-033f1a7ae732-host-slash\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.099834 master-0 kubenswrapper[4807]: I1014 13:22:32.099814 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kmj5p\" (UniqueName: \"kubernetes.io/projected/b5d52bee-f5ab-4466-97c1-033f1a7ae732-kube-api-access-kmj5p\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.099975 master-0 kubenswrapper[4807]: I1014 13:22:32.099898 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b5d52bee-f5ab-4466-97c1-033f1a7ae732-host-slash\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.100535 master-0 kubenswrapper[4807]: I1014 13:22:32.100478 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b5d52bee-f5ab-4466-97c1-033f1a7ae732-iptables-alerter-script\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.111481 master-0 kubenswrapper[4807]: I1014 13:22:32.111416 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-authentication/oauth-openshift-65687bc9c8-w9j4s"] Oct 14 13:22:32.112674 master-0 kubenswrapper[4807]: I1014 13:22:32.112632 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6"] Oct 14 13:22:32.114160 master-0 kubenswrapper[4807]: I1014 13:22:32.114122 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt"] Oct 14 13:22:32.134909 master-0 kubenswrapper[4807]: W1014 13:22:32.134848 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9719f0e3_e762_4faf_83f4_f63fa9b966c7.slice/crio-5cbe5e5d6a9ad686e6c658038213fea0faca6d7b4fbaf4448fae80683a9eb518 WatchSource:0}: Error finding container 5cbe5e5d6a9ad686e6c658038213fea0faca6d7b4fbaf4448fae80683a9eb518: Status 404 returned error can't find the container with id 5cbe5e5d6a9ad686e6c658038213fea0faca6d7b4fbaf4448fae80683a9eb518 Oct 14 13:22:32.139229 master-0 kubenswrapper[4807]: W1014 13:22:32.135958 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fda5b1_b0b4_4499_98c4_db254f06d4bf.slice/crio-1f5bf74b597139b958c27a0b8d90fa6b1f939fa7b69dac103ada1f933c2e48f6 WatchSource:0}: Error finding container 1f5bf74b597139b958c27a0b8d90fa6b1f939fa7b69dac103ada1f933c2e48f6: Status 404 returned error can't find the container with id 1f5bf74b597139b958c27a0b8d90fa6b1f939fa7b69dac103ada1f933c2e48f6 Oct 14 13:22:32.139229 master-0 kubenswrapper[4807]: W1014 13:22:32.136806 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b857c24_2a3f_4f27_9182_3b5a228e8d75.slice/crio-e0dd801d1a093c3d93b78731c719837c061695f8cf1f9c852cd2c3ce7b11944f WatchSource:0}: Error finding container e0dd801d1a093c3d93b78731c719837c061695f8cf1f9c852cd2c3ce7b11944f: Status 404 returned error can't find the container with id e0dd801d1a093c3d93b78731c719837c061695f8cf1f9c852cd2c3ce7b11944f Oct 14 13:22:32.148067 master-0 kubenswrapper[4807]: I1014 13:22:32.148022 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fkqvb" Oct 14 13:22:32.158557 master-0 kubenswrapper[4807]: I1014 13:22:32.158491 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmj5p\" (UniqueName: \"kubernetes.io/projected/b5d52bee-f5ab-4466-97c1-033f1a7ae732-kube-api-access-kmj5p\") pod \"iptables-alerter-hkmb5\" (UID: \"b5d52bee-f5ab-4466-97c1-033f1a7ae732\") " pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.204669 master-0 kubenswrapper[4807]: I1014 13:22:32.204608 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:32.217018 master-0 kubenswrapper[4807]: I1014 13:22:32.216917 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dzmh2" podStartSLOduration=101.349244938 podStartE2EDuration="2m20.216884015s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:21:46.756622677 +0000 UTC m=+101.437924511" lastFinishedPulling="2025-10-14 13:22:25.624261724 +0000 UTC m=+140.305563588" observedRunningTime="2025-10-14 13:22:32.181899494 +0000 UTC m=+146.863201318" watchObservedRunningTime="2025-10-14 13:22:32.216884015 +0000 UTC m=+146.898185849" Oct 14 13:22:32.218320 master-0 kubenswrapper[4807]: I1014 13:22:32.218260 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hkmb5" Oct 14 13:22:32.235716 master-0 kubenswrapper[4807]: W1014 13:22:32.235642 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5d52bee_f5ab_4466_97c1_033f1a7ae732.slice/crio-607d992ab6b3a09ec0af4e66d67ba221e1848aec50e7ce0fd642e70cb39103fa WatchSource:0}: Error finding container 607d992ab6b3a09ec0af4e66d67ba221e1848aec50e7ce0fd642e70cb39103fa: Status 404 returned error can't find the container with id 607d992ab6b3a09ec0af4e66d67ba221e1848aec50e7ce0fd642e70cb39103fa Oct 14 13:22:32.625963 master-0 kubenswrapper[4807]: I1014 13:22:32.625877 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:22:32.626747 master-0 kubenswrapper[4807]: I1014 13:22:32.626704 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.629112 master-0 kubenswrapper[4807]: I1014 13:22:32.629056 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-r2r7j" Oct 14 13:22:32.629886 master-0 kubenswrapper[4807]: I1014 13:22:32.629846 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Oct 14 13:22:32.629965 master-0 kubenswrapper[4807]: I1014 13:22:32.629926 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Oct 14 13:22:32.629965 master-0 kubenswrapper[4807]: I1014 13:22:32.629946 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Oct 14 13:22:32.630123 master-0 kubenswrapper[4807]: I1014 13:22:32.630088 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Oct 14 13:22:32.630318 master-0 kubenswrapper[4807]: I1014 13:22:32.630275 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Oct 14 13:22:32.632217 master-0 kubenswrapper[4807]: I1014 13:22:32.632167 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Oct 14 13:22:32.632605 master-0 kubenswrapper[4807]: I1014 13:22:32.632563 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Oct 14 13:22:32.652482 master-0 kubenswrapper[4807]: I1014 13:22:32.652420 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Oct 14 13:22:32.745053 master-0 kubenswrapper[4807]: I1014 13:22:32.744938 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" event={"ID":"c7fda5b1-b0b4-4499-98c4-db254f06d4bf","Type":"ContainerStarted","Data":"1f5bf74b597139b958c27a0b8d90fa6b1f939fa7b69dac103ada1f933c2e48f6"} Oct 14 13:22:32.748712 master-0 kubenswrapper[4807]: I1014 13:22:32.748602 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-master-0" event={"ID":"034af977-7690-48d7-882e-d52571758295","Type":"ContainerStarted","Data":"75302567aab656449da80f5791c4d3f625c9a08494a20f94630d5c34593a2dba"} Oct 14 13:22:32.751103 master-0 kubenswrapper[4807]: I1014 13:22:32.751014 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-6-master-0" event={"ID":"1e3b66b9-caf6-4445-b2b6-3117279ee481","Type":"ContainerStarted","Data":"a0875b329d9a5ee16bb0c0455d9f939cefa1d1cbb733d2eeb2bf87618d9bf535"} Oct 14 13:22:32.751103 master-0 kubenswrapper[4807]: I1014 13:22:32.751087 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-6-master-0" event={"ID":"1e3b66b9-caf6-4445-b2b6-3117279ee481","Type":"ContainerStarted","Data":"3e387b6eaad5591125dae309e1918f26519c969003e3c6c24a58d7626188af8b"} Oct 14 13:22:32.752581 master-0 kubenswrapper[4807]: I1014 13:22:32.752520 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkmb5" event={"ID":"b5d52bee-f5ab-4466-97c1-033f1a7ae732","Type":"ContainerStarted","Data":"607d992ab6b3a09ec0af4e66d67ba221e1848aec50e7ce0fd642e70cb39103fa"} Oct 14 13:22:32.754197 master-0 kubenswrapper[4807]: I1014 13:22:32.754128 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" event={"ID":"9719f0e3-e762-4faf-83f4-f63fa9b966c7","Type":"ContainerStarted","Data":"5cbe5e5d6a9ad686e6c658038213fea0faca6d7b4fbaf4448fae80683a9eb518"} Oct 14 13:22:32.755828 master-0 kubenswrapper[4807]: I1014 13:22:32.755766 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"9e0b616f-6bb0-4490-ae29-fcc199223dfc","Type":"ContainerStarted","Data":"cebbeba1b2ef44f52e7ae45267d927e54b1251834c802ce9befb58d987732a31"} Oct 14 13:22:32.757732 master-0 kubenswrapper[4807]: I1014 13:22:32.757687 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-xcgtf" event={"ID":"84347f61-07ad-4b46-80aa-c1039536accf","Type":"ContainerStarted","Data":"cc813d372fe301185b5fcc8a693fbb3639fa043bddd2cd81d5bb50eac1f27505"} Oct 14 13:22:32.757799 master-0 kubenswrapper[4807]: I1014 13:22:32.757742 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/machine-config-server-xcgtf" event={"ID":"84347f61-07ad-4b46-80aa-c1039536accf","Type":"ContainerStarted","Data":"972827555ca45ed702efb7104b7f310a873a1c21b6ebba1d15ed218525d6575e"} Oct 14 13:22:32.759221 master-0 kubenswrapper[4807]: I1014 13:22:32.759182 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" event={"ID":"5b857c24-2a3f-4f27-9182-3b5a228e8d75","Type":"ContainerStarted","Data":"e0dd801d1a093c3d93b78731c719837c061695f8cf1f9c852cd2c3ce7b11944f"} Oct 14 13:22:32.806559 master-0 kubenswrapper[4807]: I1014 13:22:32.806427 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.806975 master-0 kubenswrapper[4807]: I1014 13:22:32.806908 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.807414 master-0 kubenswrapper[4807]: I1014 13:22:32.807343 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.807634 master-0 kubenswrapper[4807]: I1014 13:22:32.807584 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srhxp\" (UniqueName: \"kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.807726 master-0 kubenswrapper[4807]: I1014 13:22:32.807679 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.807814 master-0 kubenswrapper[4807]: I1014 13:22:32.807723 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.807966 master-0 kubenswrapper[4807]: I1014 13:22:32.807924 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.825258 master-0 kubenswrapper[4807]: I1014 13:22:32.825186 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:22:32.908638 master-0 kubenswrapper[4807]: I1014 13:22:32.908430 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.908638 master-0 kubenswrapper[4807]: I1014 13:22:32.908571 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.908638 master-0 kubenswrapper[4807]: I1014 13:22:32.908607 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.908638 master-0 kubenswrapper[4807]: I1014 13:22:32.908635 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-srhxp\" (UniqueName: \"kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.909049 master-0 kubenswrapper[4807]: I1014 13:22:32.908663 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.909049 master-0 kubenswrapper[4807]: I1014 13:22:32.908689 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.909049 master-0 kubenswrapper[4807]: I1014 13:22:32.908714 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.909658 master-0 kubenswrapper[4807]: I1014 13:22:32.909621 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.910078 master-0 kubenswrapper[4807]: I1014 13:22:32.910035 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.910294 master-0 kubenswrapper[4807]: I1014 13:22:32.910231 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.910419 master-0 kubenswrapper[4807]: I1014 13:22:32.910379 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.986965 master-0 kubenswrapper[4807]: I1014 13:22:32.986900 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:32.994829 master-0 kubenswrapper[4807]: I1014 13:22:32.994774 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:33.197712 master-0 kubenswrapper[4807]: I1014 13:22:33.197647 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fkqvb"] Oct 14 13:22:33.198543 master-0 kubenswrapper[4807]: I1014 13:22:33.198475 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6qp6p"] Oct 14 13:22:33.210324 master-0 kubenswrapper[4807]: W1014 13:22:33.210254 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5db64cb_0ab9_4fd2_a09e_9070aa2976e4.slice/crio-fb64d52f19cfae4bccf89c4f18c97649214d92651881eee686fc7755ebbf07fb WatchSource:0}: Error finding container fb64d52f19cfae4bccf89c4f18c97649214d92651881eee686fc7755ebbf07fb: Status 404 returned error can't find the container with id fb64d52f19cfae4bccf89c4f18c97649214d92651881eee686fc7755ebbf07fb Oct 14 13:22:33.547935 master-0 kubenswrapper[4807]: I1014 13:22:33.547832 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-srhxp\" (UniqueName: \"kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp\") pod \"console-554dc689f9-rnmmd\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:33.555285 master-0 kubenswrapper[4807]: I1014 13:22:33.555241 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:33.767347 master-0 kubenswrapper[4807]: I1014 13:22:33.767260 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qp6p" event={"ID":"07a860df-b531-4eb6-a7a8-4f34c08b4c53","Type":"ContainerStarted","Data":"21baa060541921107639904217719491bd3800fa06936d4b366d288e2dfa9990"} Oct 14 13:22:33.769519 master-0 kubenswrapper[4807]: I1014 13:22:33.769445 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_revision-pruner-6-master-0_034af977-7690-48d7-882e-d52571758295/pruner/0.log" Oct 14 13:22:33.769628 master-0 kubenswrapper[4807]: I1014 13:22:33.769580 4807 generic.go:334] "Generic (PLEG): container finished" podID="034af977-7690-48d7-882e-d52571758295" containerID="75302567aab656449da80f5791c4d3f625c9a08494a20f94630d5c34593a2dba" exitCode=255 Oct 14 13:22:33.769801 master-0 kubenswrapper[4807]: I1014 13:22:33.769687 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-master-0" event={"ID":"034af977-7690-48d7-882e-d52571758295","Type":"ContainerDied","Data":"75302567aab656449da80f5791c4d3f625c9a08494a20f94630d5c34593a2dba"} Oct 14 13:22:33.771581 master-0 kubenswrapper[4807]: I1014 13:22:33.771511 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkqvb" event={"ID":"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4","Type":"ContainerStarted","Data":"fb64d52f19cfae4bccf89c4f18c97649214d92651881eee686fc7755ebbf07fb"} Oct 14 13:22:34.059896 master-0 kubenswrapper[4807]: I1014 13:22:34.059787 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/installer-6-master-0" podStartSLOduration=37.059763351 podStartE2EDuration="37.059763351s" podCreationTimestamp="2025-10-14 13:21:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:22:34.055827531 +0000 UTC m=+148.737129355" watchObservedRunningTime="2025-10-14 13:22:34.059763351 +0000 UTC m=+148.741065175" Oct 14 13:22:34.944660 master-0 kubenswrapper[4807]: I1014 13:22:34.944603 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/installer-6-master-0"] Oct 14 13:22:34.945523 master-0 kubenswrapper[4807]: I1014 13:22:34.945143 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.128160 master-0 kubenswrapper[4807]: I1014 13:22:35.128110 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.128160 master-0 kubenswrapper[4807]: I1014 13:22:35.128158 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.128401 master-0 kubenswrapper[4807]: I1014 13:22:35.128222 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.229715 master-0 kubenswrapper[4807]: I1014 13:22:35.229641 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.229898 master-0 kubenswrapper[4807]: I1014 13:22:35.229728 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.229898 master-0 kubenswrapper[4807]: I1014 13:22:35.229799 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.229994 master-0 kubenswrapper[4807]: I1014 13:22:35.229958 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.230095 master-0 kubenswrapper[4807]: I1014 13:22:35.230032 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:35.401728 master-0 kubenswrapper[4807]: I1014 13:22:35.401620 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-6-master-0"] Oct 14 13:22:35.645780 master-0 kubenswrapper[4807]: I1014 13:22:35.645729 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:22:35.646268 master-0 kubenswrapper[4807]: I1014 13:22:35.646243 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.648078 master-0 kubenswrapper[4807]: I1014 13:22:35.648046 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:22:35.648755 master-0 kubenswrapper[4807]: I1014 13:22:35.648737 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.653823 master-0 kubenswrapper[4807]: I1014 13:22:35.653751 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Oct 14 13:22:35.653888 master-0 kubenswrapper[4807]: I1014 13:22:35.653839 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Oct 14 13:22:35.653918 master-0 kubenswrapper[4807]: I1014 13:22:35.653901 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Oct 14 13:22:35.654124 master-0 kubenswrapper[4807]: I1014 13:22:35.653842 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"oauth-apiserver-sa-dockercfg-8gpjk" Oct 14 13:22:35.654451 master-0 kubenswrapper[4807]: I1014 13:22:35.654430 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Oct 14 13:22:35.654665 master-0 kubenswrapper[4807]: I1014 13:22:35.654646 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Oct 14 13:22:35.654723 master-0 kubenswrapper[4807]: I1014 13:22:35.654704 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"openshift-service-ca.crt" Oct 14 13:22:35.654753 master-0 kubenswrapper[4807]: I1014 13:22:35.654719 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"kube-root-ca.crt" Oct 14 13:22:35.654843 master-0 kubenswrapper[4807]: I1014 13:22:35.654827 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"etcd-serving-ca" Oct 14 13:22:35.654961 master-0 kubenswrapper[4807]: I1014 13:22:35.654943 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Oct 14 13:22:35.655018 master-0 kubenswrapper[4807]: I1014 13:22:35.654996 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Oct 14 13:22:35.655167 master-0 kubenswrapper[4807]: I1014 13:22:35.655149 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Oct 14 13:22:35.655198 master-0 kubenswrapper[4807]: I1014 13:22:35.655156 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Oct 14 13:22:35.655248 master-0 kubenswrapper[4807]: I1014 13:22:35.655218 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"config" Oct 14 13:22:35.655291 master-0 kubenswrapper[4807]: I1014 13:22:35.655240 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Oct 14 13:22:35.655317 master-0 kubenswrapper[4807]: I1014 13:22:35.655299 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"audit-1" Oct 14 13:22:35.655606 master-0 kubenswrapper[4807]: I1014 13:22:35.655576 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"openshift-apiserver-sa-dockercfg-95k8q" Oct 14 13:22:35.655794 master-0 kubenswrapper[4807]: I1014 13:22:35.655776 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Oct 14 13:22:35.655935 master-0 kubenswrapper[4807]: I1014 13:22:35.655917 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"image-import-ca" Oct 14 13:22:35.666010 master-0 kubenswrapper[4807]: I1014 13:22:35.665944 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-apiserver"/"trusted-ca-bundle" Oct 14 13:22:35.758917 master-0 kubenswrapper[4807]: I1014 13:22:35.757188 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_revision-pruner-6-master-0_034af977-7690-48d7-882e-d52571758295/pruner/0.log" Oct 14 13:22:35.758917 master-0 kubenswrapper[4807]: I1014 13:22:35.757262 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:35.779939 master-0 kubenswrapper[4807]: I1014 13:22:35.779159 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hkmb5" event={"ID":"b5d52bee-f5ab-4466-97c1-033f1a7ae732","Type":"ContainerStarted","Data":"383b727f20cccdbfcb3b7744a016be368d9b9dfcf71643fdb6e0f0b17ef552f0"} Oct 14 13:22:35.782519 master-0 kubenswrapper[4807]: I1014 13:22:35.781389 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-scheduler_revision-pruner-6-master-0_034af977-7690-48d7-882e-d52571758295/pruner/0.log" Oct 14 13:22:35.782519 master-0 kubenswrapper[4807]: I1014 13:22:35.781440 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/revision-pruner-6-master-0" event={"ID":"034af977-7690-48d7-882e-d52571758295","Type":"ContainerDied","Data":"ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181"} Oct 14 13:22:35.783068 master-0 kubenswrapper[4807]: I1014 13:22:35.783013 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef40dbda440f005d1df338a2d4bebd9bf2733caa6b67ad7d926f33cfdeeb7181" Oct 14 13:22:35.783122 master-0 kubenswrapper[4807]: I1014 13:22:35.783056 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/revision-pruner-6-master-0" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835290 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835346 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835375 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835396 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835429 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835481 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835505 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835592 master-0 kubenswrapper[4807]: I1014 13:22:35.835522 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835904 master-0 kubenswrapper[4807]: I1014 13:22:35.835789 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835904 master-0 kubenswrapper[4807]: I1014 13:22:35.835863 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-747zn\" (UniqueName: \"kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835904 master-0 kubenswrapper[4807]: I1014 13:22:35.835891 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.835984 master-0 kubenswrapper[4807]: I1014 13:22:35.835940 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbs5\" (UniqueName: \"kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.835984 master-0 kubenswrapper[4807]: I1014 13:22:35.835964 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.836039 master-0 kubenswrapper[4807]: I1014 13:22:35.835984 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.836039 master-0 kubenswrapper[4807]: I1014 13:22:35.836026 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.836099 master-0 kubenswrapper[4807]: I1014 13:22:35.836056 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.836288 master-0 kubenswrapper[4807]: I1014 13:22:35.836202 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.836288 master-0 kubenswrapper[4807]: I1014 13:22:35.836233 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.836288 master-0 kubenswrapper[4807]: I1014 13:22:35.836279 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.897994 master-0 kubenswrapper[4807]: I1014 13:22:35.897921 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/revision-pruner-6-master-0" podStartSLOduration=38.653862016 podStartE2EDuration="40.897900547s" podCreationTimestamp="2025-10-14 13:21:55 +0000 UTC" firstStartedPulling="2025-10-14 13:22:29.35926595 +0000 UTC m=+144.040567814" lastFinishedPulling="2025-10-14 13:22:31.603304521 +0000 UTC m=+146.284606345" observedRunningTime="2025-10-14 13:22:35.845160715 +0000 UTC m=+150.526462559" watchObservedRunningTime="2025-10-14 13:22:35.897900547 +0000 UTC m=+150.579202371" Oct 14 13:22:35.899926 master-0 kubenswrapper[4807]: I1014 13:22:35.899872 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:22:35.900559 master-0 kubenswrapper[4807]: I1014 13:22:35.900528 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:22:35.937415 master-0 kubenswrapper[4807]: I1014 13:22:35.937324 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir\") pod \"034af977-7690-48d7-882e-d52571758295\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " Oct 14 13:22:35.937415 master-0 kubenswrapper[4807]: I1014 13:22:35.937399 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") pod \"034af977-7690-48d7-882e-d52571758295\" (UID: \"034af977-7690-48d7-882e-d52571758295\") " Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937551 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937602 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937642 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937629 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "034af977-7690-48d7-882e-d52571758295" (UID: "034af977-7690-48d7-882e-d52571758295"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937676 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937702 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937729 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937752 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937794 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937834 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937862 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937891 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937934 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937957 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937980 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.937998 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.939873 master-0 kubenswrapper[4807]: I1014 13:22:35.938021 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938042 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-747zn\" (UniqueName: \"kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938066 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938110 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbs5\" (UniqueName: \"kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938156 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/034af977-7690-48d7-882e-d52571758295-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938426 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.938742 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939010 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939131 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939339 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939474 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939515 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939544 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.939569 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940331 master-0 kubenswrapper[4807]: I1014 13:22:35.940043 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.940775 master-0 kubenswrapper[4807]: I1014 13:22:35.940732 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.941440 master-0 kubenswrapper[4807]: I1014 13:22:35.941375 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "034af977-7690-48d7-882e-d52571758295" (UID: "034af977-7690-48d7-882e-d52571758295"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:22:35.942174 master-0 kubenswrapper[4807]: I1014 13:22:35.942135 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.942975 master-0 kubenswrapper[4807]: I1014 13:22:35.942942 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.943544 master-0 kubenswrapper[4807]: I1014 13:22:35.943501 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.944401 master-0 kubenswrapper[4807]: I1014 13:22:35.944366 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:35.944504 master-0 kubenswrapper[4807]: I1014 13:22:35.944416 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:35.958582 master-0 kubenswrapper[4807]: I1014 13:22:35.958529 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:36.039980 master-0 kubenswrapper[4807]: I1014 13:22:36.039912 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/034af977-7690-48d7-882e-d52571758295-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:22:36.115547 master-0 kubenswrapper[4807]: I1014 13:22:36.115478 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access\") pod \"installer-6-master-0\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:36.160173 master-0 kubenswrapper[4807]: I1014 13:22:36.159624 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:22:36.558039 master-0 kubenswrapper[4807]: I1014 13:22:36.557981 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-76c4979bdc-mgff4"] Oct 14 13:22:36.558380 master-0 kubenswrapper[4807]: E1014 13:22:36.558162 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="034af977-7690-48d7-882e-d52571758295" containerName="pruner" Oct 14 13:22:36.558380 master-0 kubenswrapper[4807]: I1014 13:22:36.558175 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="034af977-7690-48d7-882e-d52571758295" containerName="pruner" Oct 14 13:22:36.558380 master-0 kubenswrapper[4807]: I1014 13:22:36.558230 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="034af977-7690-48d7-882e-d52571758295" containerName="pruner" Oct 14 13:22:36.558590 master-0 kubenswrapper[4807]: I1014 13:22:36.558555 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.562851 master-0 kubenswrapper[4807]: I1014 13:22:36.562362 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"kubelet-serving-ca-bundle" Oct 14 13:22:36.562851 master-0 kubenswrapper[4807]: I1014 13:22:36.562539 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Oct 14 13:22:36.564133 master-0 kubenswrapper[4807]: I1014 13:22:36.563617 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-3mlibjliosje2" Oct 14 13:22:36.564133 master-0 kubenswrapper[4807]: I1014 13:22:36.563893 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"metrics-server-audit-profiles" Oct 14 13:22:36.564133 master-0 kubenswrapper[4807]: I1014 13:22:36.563944 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Oct 14 13:22:36.564133 master-0 kubenswrapper[4807]: I1014 13:22:36.564112 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-bg9tg" Oct 14 13:22:36.649642 master-0 kubenswrapper[4807]: I1014 13:22:36.649539 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d0db662-28b6-4bb1-9e26-87a39fc0344d-audit-log\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.649642 master-0 kubenswrapper[4807]: I1014 13:22:36.649659 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-server-tls\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.650009 master-0 kubenswrapper[4807]: I1014 13:22:36.649752 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-client-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.650009 master-0 kubenswrapper[4807]: I1014 13:22:36.649800 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-metrics-server-audit-profiles\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.650009 master-0 kubenswrapper[4807]: I1014 13:22:36.649854 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-client-certs\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.650009 master-0 kubenswrapper[4807]: I1014 13:22:36.649937 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.650009 master-0 kubenswrapper[4807]: I1014 13:22:36.649996 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfpcv\" (UniqueName: \"kubernetes.io/projected/7d0db662-28b6-4bb1-9e26-87a39fc0344d-kube-api-access-kfpcv\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751024 master-0 kubenswrapper[4807]: I1014 13:22:36.750967 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d0db662-28b6-4bb1-9e26-87a39fc0344d-audit-log\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751024 master-0 kubenswrapper[4807]: I1014 13:22:36.751023 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-server-tls\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751356 master-0 kubenswrapper[4807]: I1014 13:22:36.751053 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-client-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751356 master-0 kubenswrapper[4807]: I1014 13:22:36.751080 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-metrics-server-audit-profiles\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751356 master-0 kubenswrapper[4807]: I1014 13:22:36.751113 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-client-certs\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751356 master-0 kubenswrapper[4807]: I1014 13:22:36.751139 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751356 master-0 kubenswrapper[4807]: I1014 13:22:36.751171 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kfpcv\" (UniqueName: \"kubernetes.io/projected/7d0db662-28b6-4bb1-9e26-87a39fc0344d-kube-api-access-kfpcv\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.751762 master-0 kubenswrapper[4807]: I1014 13:22:36.751708 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7d0db662-28b6-4bb1-9e26-87a39fc0344d-audit-log\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.752561 master-0 kubenswrapper[4807]: I1014 13:22:36.752535 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-metrics-server-audit-profiles\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.753667 master-0 kubenswrapper[4807]: I1014 13:22:36.753603 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d0db662-28b6-4bb1-9e26-87a39fc0344d-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.754974 master-0 kubenswrapper[4807]: I1014 13:22:36.754943 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-client-ca-bundle\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.755158 master-0 kubenswrapper[4807]: I1014 13:22:36.755115 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-client-certs\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.755628 master-0 kubenswrapper[4807]: I1014 13:22:36.755578 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7d0db662-28b6-4bb1-9e26-87a39fc0344d-secret-metrics-server-tls\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:36.880643 master-0 kubenswrapper[4807]: W1014 13:22:36.880585 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15467de3_2646_47a5_92e4_19140a65d17f.slice/crio-08d10eb2607e7d3bf12c88dd24d77ed0f43885657e28eb47cd7d8e48f314c93d WatchSource:0}: Error finding container 08d10eb2607e7d3bf12c88dd24d77ed0f43885657e28eb47cd7d8e48f314c93d: Status 404 returned error can't find the container with id 08d10eb2607e7d3bf12c88dd24d77ed0f43885657e28eb47cd7d8e48f314c93d Oct 14 13:22:36.886409 master-0 kubenswrapper[4807]: I1014 13:22:36.884878 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbs5\" (UniqueName: \"kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5\") pod \"apiserver-5f68d4c887-pqcgn\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:37.160144 master-0 kubenswrapper[4807]: I1014 13:22:37.160064 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:37.193222 master-0 kubenswrapper[4807]: I1014 13:22:37.193126 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/machine-config-server-xcgtf" podStartSLOduration=9.193097628 podStartE2EDuration="9.193097628s" podCreationTimestamp="2025-10-14 13:22:28 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:22:36.560778277 +0000 UTC m=+151.242080101" watchObservedRunningTime="2025-10-14 13:22:37.193097628 +0000 UTC m=+151.874399452" Oct 14 13:22:37.193674 master-0 kubenswrapper[4807]: I1014 13:22:37.193607 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76c4979bdc-mgff4"] Oct 14 13:22:37.194350 master-0 kubenswrapper[4807]: I1014 13:22:37.194300 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:22:37.220849 master-0 kubenswrapper[4807]: I1014 13:22:37.220733 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-747zn\" (UniqueName: \"kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn\") pod \"apiserver-84c8b8d745-wnpsp\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:37.471595 master-0 kubenswrapper[4807]: I1014 13:22:37.471506 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:37.614491 master-0 kubenswrapper[4807]: I1014 13:22:37.614409 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfpcv\" (UniqueName: \"kubernetes.io/projected/7d0db662-28b6-4bb1-9e26-87a39fc0344d-kube-api-access-kfpcv\") pod \"metrics-server-76c4979bdc-mgff4\" (UID: \"7d0db662-28b6-4bb1-9e26-87a39fc0344d\") " pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:37.772128 master-0 kubenswrapper[4807]: I1014 13:22:37.771909 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:37.793344 master-0 kubenswrapper[4807]: I1014 13:22:37.793281 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" event={"ID":"9719f0e3-e762-4faf-83f4-f63fa9b966c7","Type":"ContainerStarted","Data":"4b2c7bbdab3fe945cca46313876da0960235b3172b926f9886c428f9d01c2c40"} Oct 14 13:22:37.793527 master-0 kubenswrapper[4807]: I1014 13:22:37.793488 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:37.795518 master-0 kubenswrapper[4807]: I1014 13:22:37.795430 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"9e0b616f-6bb0-4490-ae29-fcc199223dfc","Type":"ContainerStarted","Data":"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e"} Oct 14 13:22:37.795639 master-0 kubenswrapper[4807]: I1014 13:22:37.795510 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-controller-manager/installer-5-master-0" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" containerName="installer" containerID="cri-o://7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e" gracePeriod=30 Oct 14 13:22:37.810689 master-0 kubenswrapper[4807]: I1014 13:22:37.808945 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qp6p" event={"ID":"07a860df-b531-4eb6-a7a8-4f34c08b4c53","Type":"ContainerStarted","Data":"a5db3be1ab9ecc567461e048ba0ea59320faf6885a9281635ce4ca1f70f670db"} Oct 14 13:22:37.810689 master-0 kubenswrapper[4807]: I1014 13:22:37.808987 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6qp6p" event={"ID":"07a860df-b531-4eb6-a7a8-4f34c08b4c53","Type":"ContainerStarted","Data":"0e276b0fa8db956e2583ab774c98485ce4ddd770e3d48b1c3011e4fd6bb66a6f"} Oct 14 13:22:37.810689 master-0 kubenswrapper[4807]: I1014 13:22:37.809579 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:37.813575 master-0 kubenswrapper[4807]: I1014 13:22:37.813529 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" event={"ID":"5b857c24-2a3f-4f27-9182-3b5a228e8d75","Type":"ContainerStarted","Data":"2aaf372235f104668fecffc074a0a1d089b65bd56abe52fc0de9a85de6cab145"} Oct 14 13:22:37.814266 master-0 kubenswrapper[4807]: I1014 13:22:37.814237 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:37.816528 master-0 kubenswrapper[4807]: I1014 13:22:37.816491 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" event={"ID":"c7fda5b1-b0b4-4499-98c4-db254f06d4bf","Type":"ContainerStarted","Data":"f1f1b47ec6baacccd2b71508a7f8d078830b70c45feff12eca7f650266d35883"} Oct 14 13:22:37.817119 master-0 kubenswrapper[4807]: I1014 13:22:37.817079 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:37.818744 master-0 kubenswrapper[4807]: I1014 13:22:37.818704 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fkqvb" event={"ID":"c5db64cb-0ab9-4fd2-a09e-9070aa2976e4","Type":"ContainerStarted","Data":"f09115945c50407b094b84eaff665d5de1193b90a2e2b9260378ffed09dc435e"} Oct 14 13:22:37.820790 master-0 kubenswrapper[4807]: I1014 13:22:37.820743 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554dc689f9-rnmmd" event={"ID":"15467de3-2646-47a5-92e4-19140a65d17f","Type":"ContainerStarted","Data":"08d10eb2607e7d3bf12c88dd24d77ed0f43885657e28eb47cd7d8e48f314c93d"} Oct 14 13:22:37.821496 master-0 kubenswrapper[4807]: I1014 13:22:37.821423 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" Oct 14 13:22:38.249201 master-0 kubenswrapper[4807]: I1014 13:22:38.249151 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-5-master-0_9e0b616f-6bb0-4490-ae29-fcc199223dfc/installer/0.log" Oct 14 13:22:38.249921 master-0 kubenswrapper[4807]: I1014 13:22:38.249240 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:38.369604 master-0 kubenswrapper[4807]: I1014 13:22:38.369502 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock\") pod \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " Oct 14 13:22:38.369604 master-0 kubenswrapper[4807]: I1014 13:22:38.369573 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir\") pod \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " Oct 14 13:22:38.369869 master-0 kubenswrapper[4807]: I1014 13:22:38.369634 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") pod \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\" (UID: \"9e0b616f-6bb0-4490-ae29-fcc199223dfc\") " Oct 14 13:22:38.369869 master-0 kubenswrapper[4807]: I1014 13:22:38.369660 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock" (OuterVolumeSpecName: "var-lock") pod "9e0b616f-6bb0-4490-ae29-fcc199223dfc" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:22:38.369869 master-0 kubenswrapper[4807]: I1014 13:22:38.369751 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "9e0b616f-6bb0-4490-ae29-fcc199223dfc" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:22:38.370024 master-0 kubenswrapper[4807]: I1014 13:22:38.369989 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:22:38.370024 master-0 kubenswrapper[4807]: I1014 13:22:38.370017 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:22:38.372865 master-0 kubenswrapper[4807]: I1014 13:22:38.372836 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "9e0b616f-6bb0-4490-ae29-fcc199223dfc" (UID: "9e0b616f-6bb0-4490-ae29-fcc199223dfc"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:22:38.471487 master-0 kubenswrapper[4807]: I1014 13:22:38.471422 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/9e0b616f-6bb0-4490-ae29-fcc199223dfc-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:22:38.488827 master-0 kubenswrapper[4807]: I1014 13:22:38.488639 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/installer-6-master-0"] Oct 14 13:22:38.502821 master-0 kubenswrapper[4807]: W1014 13:22:38.502753 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a905fdc_a19f_4578_a4a3_100fbe944829.slice/crio-5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473 WatchSource:0}: Error finding container 5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473: Status 404 returned error can't find the container with id 5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473 Oct 14 13:22:38.729962 master-0 kubenswrapper[4807]: I1014 13:22:38.729415 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:22:38.730914 master-0 kubenswrapper[4807]: I1014 13:22:38.730839 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:22:38.740826 master-0 kubenswrapper[4807]: W1014 13:22:38.740754 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3002128a_ef6f_4688_ab72_9f935bd4241d.slice/crio-06c029e796ca65e2aadda42cfd4e031fed4093c948f26f02bf07ab055a3d15d3 WatchSource:0}: Error finding container 06c029e796ca65e2aadda42cfd4e031fed4093c948f26f02bf07ab055a3d15d3: Status 404 returned error can't find the container with id 06c029e796ca65e2aadda42cfd4e031fed4093c948f26f02bf07ab055a3d15d3 Oct 14 13:22:38.793789 master-0 kubenswrapper[4807]: I1014 13:22:38.793688 4807 patch_prober.go:28] interesting pod/route-controller-manager-7968c6c999-tlxv6 container/route-controller-manager namespace/openshift-route-controller-manager: Readiness probe status=failure output="Get \"https://10.130.0.10:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:22:38.794119 master-0 kubenswrapper[4807]: I1014 13:22:38.793774 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" podUID="9719f0e3-e762-4faf-83f4-f63fa9b966c7" containerName="route-controller-manager" probeResult="failure" output="Get \"https://10.130.0.10:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 14 13:22:38.819281 master-0 kubenswrapper[4807]: I1014 13:22:38.819207 4807 patch_prober.go:28] interesting pod/oauth-openshift-65687bc9c8-w9j4s container/oauth-openshift namespace/openshift-authentication: Readiness probe status=failure output="Get \"https://10.130.0.9:6443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:22:38.819574 master-0 kubenswrapper[4807]: I1014 13:22:38.819306 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" podUID="c7fda5b1-b0b4-4499-98c4-db254f06d4bf" containerName="oauth-openshift" probeResult="failure" output="Get \"https://10.130.0.9:6443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" Oct 14 13:22:38.830610 master-0 kubenswrapper[4807]: I1014 13:22:38.830559 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-controller-manager_installer-5-master-0_9e0b616f-6bb0-4490-ae29-fcc199223dfc/installer/0.log" Oct 14 13:22:38.830703 master-0 kubenswrapper[4807]: I1014 13:22:38.830632 4807 generic.go:334] "Generic (PLEG): container finished" podID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" containerID="7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e" exitCode=2 Oct 14 13:22:38.830748 master-0 kubenswrapper[4807]: I1014 13:22:38.830707 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"9e0b616f-6bb0-4490-ae29-fcc199223dfc","Type":"ContainerDied","Data":"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e"} Oct 14 13:22:38.830803 master-0 kubenswrapper[4807]: I1014 13:22:38.830735 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-5-master-0" Oct 14 13:22:38.830803 master-0 kubenswrapper[4807]: I1014 13:22:38.830767 4807 scope.go:117] "RemoveContainer" containerID="7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e" Oct 14 13:22:38.830983 master-0 kubenswrapper[4807]: I1014 13:22:38.830751 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-5-master-0" event={"ID":"9e0b616f-6bb0-4490-ae29-fcc199223dfc","Type":"ContainerDied","Data":"cebbeba1b2ef44f52e7ae45267d927e54b1251834c802ce9befb58d987732a31"} Oct 14 13:22:38.837868 master-0 kubenswrapper[4807]: I1014 13:22:38.837798 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-6-master-0" event={"ID":"6a905fdc-a19f-4578-a4a3-100fbe944829","Type":"ContainerStarted","Data":"5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473"} Oct 14 13:22:38.840968 master-0 kubenswrapper[4807]: I1014 13:22:38.840898 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerStarted","Data":"06c029e796ca65e2aadda42cfd4e031fed4093c948f26f02bf07ab055a3d15d3"} Oct 14 13:22:38.843171 master-0 kubenswrapper[4807]: I1014 13:22:38.843114 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" event={"ID":"a65d0030-ef03-4506-9d47-06c1eeda7831","Type":"ContainerStarted","Data":"98d3b856a1082ec427202ef061f3c34dcb72fa8efd6134e3a8a35c8b1321644c"} Oct 14 13:22:38.855025 master-0 kubenswrapper[4807]: I1014 13:22:38.854968 4807 scope.go:117] "RemoveContainer" containerID="7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e" Oct 14 13:22:38.855685 master-0 kubenswrapper[4807]: E1014 13:22:38.855597 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e\": container with ID starting with 7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e not found: ID does not exist" containerID="7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e" Oct 14 13:22:38.855903 master-0 kubenswrapper[4807]: I1014 13:22:38.855665 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e"} err="failed to get container status \"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e\": rpc error: code = NotFound desc = could not find container \"7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e\": container with ID starting with 7e387ef1260bd97b2992f6273f17fd7343f091c5b25f3b84d99b74beb09e180e not found: ID does not exist" Oct 14 13:22:39.540126 master-0 kubenswrapper[4807]: I1014 13:22:39.539559 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" Oct 14 13:22:39.540850 master-0 kubenswrapper[4807]: I1014 13:22:39.540613 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" Oct 14 13:22:39.681411 master-0 kubenswrapper[4807]: I1014 13:22:39.681341 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-76c4979bdc-mgff4"] Oct 14 13:22:39.849887 master-0 kubenswrapper[4807]: I1014 13:22:39.849819 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-6-master-0" event={"ID":"6a905fdc-a19f-4578-a4a3-100fbe944829","Type":"ContainerStarted","Data":"4220eebbbf98106aea65c744a9f3dc86e7ae558ecca28c1cd3ef3b4eefeef8ba"} Oct 14 13:22:40.161745 master-0 kubenswrapper[4807]: W1014 13:22:40.161621 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d0db662_28b6_4bb1_9e26_87a39fc0344d.slice/crio-f1dcfadf728b2981b5abe67e4fdc9c97cb0b9519c53337ea4c18e3192c116552 WatchSource:0}: Error finding container f1dcfadf728b2981b5abe67e4fdc9c97cb0b9519c53337ea4c18e3192c116552: Status 404 returned error can't find the container with id f1dcfadf728b2981b5abe67e4fdc9c97cb0b9519c53337ea4c18e3192c116552 Oct 14 13:22:40.853905 master-0 kubenswrapper[4807]: I1014 13:22:40.853652 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" event={"ID":"7d0db662-28b6-4bb1-9e26-87a39fc0344d","Type":"ContainerStarted","Data":"f1dcfadf728b2981b5abe67e4fdc9c97cb0b9519c53337ea4c18e3192c116552"} Oct 14 13:22:40.855618 master-0 kubenswrapper[4807]: I1014 13:22:40.855567 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554dc689f9-rnmmd" event={"ID":"15467de3-2646-47a5-92e4-19140a65d17f","Type":"ContainerStarted","Data":"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8"} Oct 14 13:22:41.755009 master-0 kubenswrapper[4807]: I1014 13:22:41.754900 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hkmb5" podStartSLOduration=10.754879558 podStartE2EDuration="10.754879558s" podCreationTimestamp="2025-10-14 13:22:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:22:41.655760554 +0000 UTC m=+156.337062408" watchObservedRunningTime="2025-10-14 13:22:41.754879558 +0000 UTC m=+156.436181382" Oct 14 13:22:41.790366 master-0 kubenswrapper[4807]: I1014 13:22:41.790257 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-6qp6p" podStartSLOduration=7.097181929 podStartE2EDuration="10.790237088s" podCreationTimestamp="2025-10-14 13:22:31 +0000 UTC" firstStartedPulling="2025-10-14 13:22:33.203777445 +0000 UTC m=+147.885079299" lastFinishedPulling="2025-10-14 13:22:36.896832634 +0000 UTC m=+151.578134458" observedRunningTime="2025-10-14 13:22:41.787753395 +0000 UTC m=+156.469055259" watchObservedRunningTime="2025-10-14 13:22:41.790237088 +0000 UTC m=+156.471538922" Oct 14 13:22:41.824833 master-0 kubenswrapper[4807]: I1014 13:22:41.824759 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-authentication/oauth-openshift-65687bc9c8-w9j4s" podStartSLOduration=30.136410714 podStartE2EDuration="34.824733997s" podCreationTimestamp="2025-10-14 13:22:07 +0000 UTC" firstStartedPulling="2025-10-14 13:22:32.141169327 +0000 UTC m=+146.822471171" lastFinishedPulling="2025-10-14 13:22:36.82949263 +0000 UTC m=+151.510794454" observedRunningTime="2025-10-14 13:22:41.824020798 +0000 UTC m=+156.505322643" watchObservedRunningTime="2025-10-14 13:22:41.824733997 +0000 UTC m=+156.506035831" Oct 14 13:22:41.853986 master-0 kubenswrapper[4807]: I1014 13:22:41.853879 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-controller-manager/controller-manager-78c5d9fccd-5xwlt" podStartSLOduration=30.125886546 podStartE2EDuration="34.853859048s" podCreationTimestamp="2025-10-14 13:22:07 +0000 UTC" firstStartedPulling="2025-10-14 13:22:32.139502505 +0000 UTC m=+146.820804349" lastFinishedPulling="2025-10-14 13:22:36.867475027 +0000 UTC m=+151.548776851" observedRunningTime="2025-10-14 13:22:41.852159465 +0000 UTC m=+156.533461289" watchObservedRunningTime="2025-10-14 13:22:41.853859048 +0000 UTC m=+156.535160862" Oct 14 13:22:41.909750 master-0 kubenswrapper[4807]: I1014 13:22:41.909636 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-route-controller-manager/route-controller-manager-7968c6c999-tlxv6" podStartSLOduration=30.179533232 podStartE2EDuration="34.909605698s" podCreationTimestamp="2025-10-14 13:22:07 +0000 UTC" firstStartedPulling="2025-10-14 13:22:32.137332349 +0000 UTC m=+146.818634213" lastFinishedPulling="2025-10-14 13:22:36.867404855 +0000 UTC m=+151.548706679" observedRunningTime="2025-10-14 13:22:41.908774607 +0000 UTC m=+156.590076451" watchObservedRunningTime="2025-10-14 13:22:41.909605698 +0000 UTC m=+156.590907522" Oct 14 13:22:41.937689 master-0 kubenswrapper[4807]: I1014 13:22:41.937594 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fkqvb" podStartSLOduration=10.270836411 podStartE2EDuration="13.93756363s" podCreationTimestamp="2025-10-14 13:22:28 +0000 UTC" firstStartedPulling="2025-10-14 13:22:33.212723303 +0000 UTC m=+147.894025127" lastFinishedPulling="2025-10-14 13:22:36.879450512 +0000 UTC m=+151.560752346" observedRunningTime="2025-10-14 13:22:41.935652131 +0000 UTC m=+156.616953955" watchObservedRunningTime="2025-10-14 13:22:41.93756363 +0000 UTC m=+156.618865454" Oct 14 13:22:41.974354 master-0 kubenswrapper[4807]: I1014 13:22:41.974262 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-554dc689f9-rnmmd" podStartSLOduration=39.636918403 podStartE2EDuration="42.974237374s" podCreationTimestamp="2025-10-14 13:21:59 +0000 UTC" firstStartedPulling="2025-10-14 13:22:36.888270246 +0000 UTC m=+151.569572080" lastFinishedPulling="2025-10-14 13:22:40.225589227 +0000 UTC m=+154.906891051" observedRunningTime="2025-10-14 13:22:41.97408464 +0000 UTC m=+156.655386484" watchObservedRunningTime="2025-10-14 13:22:41.974237374 +0000 UTC m=+156.655539198" Oct 14 13:22:42.075169 master-0 kubenswrapper[4807]: I1014 13:22:42.074878 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/installer-6-master-0" podStartSLOduration=8.074854916 podStartE2EDuration="8.074854916s" podCreationTimestamp="2025-10-14 13:22:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:22:42.02359053 +0000 UTC m=+156.704892354" watchObservedRunningTime="2025-10-14 13:22:42.074854916 +0000 UTC m=+156.756156730" Oct 14 13:22:42.132897 master-0 kubenswrapper[4807]: I1014 13:22:42.132807 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:22:42.133745 master-0 kubenswrapper[4807]: I1014 13:22:42.133711 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-controller-manager/installer-5-master-0"] Oct 14 13:22:42.266841 master-0 kubenswrapper[4807]: I1014 13:22:42.266755 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" path="/var/lib/kubelet/pods/9e0b616f-6bb0-4490-ae29-fcc199223dfc/volumes" Oct 14 13:22:43.556905 master-0 kubenswrapper[4807]: I1014 13:22:43.555657 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:43.556905 master-0 kubenswrapper[4807]: I1014 13:22:43.556074 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:43.557345 master-0 kubenswrapper[4807]: I1014 13:22:43.557054 4807 patch_prober.go:28] interesting pod/console-554dc689f9-rnmmd container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.130.0.14:8443/health\": dial tcp 10.130.0.14:8443: connect: connection refused" start-of-body= Oct 14 13:22:43.557345 master-0 kubenswrapper[4807]: I1014 13:22:43.557116 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-console/console-554dc689f9-rnmmd" podUID="15467de3-2646-47a5-92e4-19140a65d17f" containerName="console" probeResult="failure" output="Get \"https://10.130.0.14:8443/health\": dial tcp 10.130.0.14:8443: connect: connection refused" Oct 14 13:22:43.876353 master-0 kubenswrapper[4807]: I1014 13:22:43.876263 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" event={"ID":"7d0db662-28b6-4bb1-9e26-87a39fc0344d","Type":"ContainerStarted","Data":"d025013078e7d1b14048f6f4b6a215ec47542c674bde9a7905555bf404ce5ef7"} Oct 14 13:22:43.876666 master-0 kubenswrapper[4807]: I1014 13:22:43.876568 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:22:43.878640 master-0 kubenswrapper[4807]: I1014 13:22:43.878582 4807 generic.go:334] "Generic (PLEG): container finished" podID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerID="7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be" exitCode=0 Oct 14 13:22:43.878795 master-0 kubenswrapper[4807]: I1014 13:22:43.878726 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerDied","Data":"7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be"} Oct 14 13:22:43.882610 master-0 kubenswrapper[4807]: I1014 13:22:43.881971 4807 generic.go:334] "Generic (PLEG): container finished" podID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerID="d3c64bce8c8e1cb9f450a8985b72dab97abd94de52a3ff4602d575e8d61d085e" exitCode=0 Oct 14 13:22:43.882610 master-0 kubenswrapper[4807]: I1014 13:22:43.882078 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" event={"ID":"a65d0030-ef03-4506-9d47-06c1eeda7831","Type":"ContainerDied","Data":"d3c64bce8c8e1cb9f450a8985b72dab97abd94de52a3ff4602d575e8d61d085e"} Oct 14 13:22:44.890140 master-0 kubenswrapper[4807]: I1014 13:22:44.890022 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerStarted","Data":"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509"} Oct 14 13:22:44.893026 master-0 kubenswrapper[4807]: I1014 13:22:44.892974 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" event={"ID":"a65d0030-ef03-4506-9d47-06c1eeda7831","Type":"ContainerStarted","Data":"50fe65e67b31aca90bbce3f2d0d071e1fd07429f3f7d008f6e06c12d8e6fb702"} Oct 14 13:22:46.903236 master-0 kubenswrapper[4807]: I1014 13:22:46.903170 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerStarted","Data":"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199"} Oct 14 13:22:47.160839 master-0 kubenswrapper[4807]: I1014 13:22:47.160655 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:47.160839 master-0 kubenswrapper[4807]: I1014 13:22:47.160746 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:47.210118 master-0 kubenswrapper[4807]: I1014 13:22:47.210059 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6qp6p" Oct 14 13:22:47.472953 master-0 kubenswrapper[4807]: I1014 13:22:47.472750 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:47.472953 master-0 kubenswrapper[4807]: I1014 13:22:47.472854 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:48.773349 master-0 kubenswrapper[4807]: I1014 13:22:48.773287 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:48.778699 master-0 kubenswrapper[4807]: I1014 13:22:48.778636 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: I1014 13:22:48.903292 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]etcd ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [-]poststarthook/authorization.openshift.io-bootstrapclusterroles failed: reason withheld Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [-]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa failed: reason withheld Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:22:48.903490 master-0 kubenswrapper[4807]: livez check failed Oct 14 13:22:48.904716 master-0 kubenswrapper[4807]: I1014 13:22:48.903551 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:22:49.224992 master-0 kubenswrapper[4807]: I1014 13:22:49.224907 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" podStartSLOduration=478.058338411 podStartE2EDuration="8m1.224890603s" podCreationTimestamp="2025-10-14 13:14:48 +0000 UTC" firstStartedPulling="2025-10-14 13:22:40.164995524 +0000 UTC m=+154.846297348" lastFinishedPulling="2025-10-14 13:22:43.331547716 +0000 UTC m=+158.012849540" observedRunningTime="2025-10-14 13:22:46.855686114 +0000 UTC m=+161.536987938" watchObservedRunningTime="2025-10-14 13:22:49.224890603 +0000 UTC m=+163.906192427" Oct 14 13:22:50.435120 master-0 kubenswrapper[4807]: I1014 13:22:50.434970 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:50.440038 master-0 kubenswrapper[4807]: I1014 13:22:50.439986 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/43d751fa-69e4-4205-b368-4aa3167a71a9-metrics-certs\") pod \"network-metrics-daemon-p5vjv\" (UID: \"43d751fa-69e4-4205-b368-4aa3167a71a9\") " pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:50.524289 master-0 kubenswrapper[4807]: I1014 13:22:50.524192 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-p5vjv" Oct 14 13:22:50.536709 master-0 kubenswrapper[4807]: I1014 13:22:50.536604 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:50.542852 master-0 kubenswrapper[4807]: I1014 13:22:50.542780 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvcqq\" (UniqueName: \"kubernetes.io/projected/65b2dcab-f199-48f6-9446-305c78399647-kube-api-access-kvcqq\") pod \"network-check-target-vmk66\" (UID: \"65b2dcab-f199-48f6-9446-305c78399647\") " pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:50.796649 master-0 kubenswrapper[4807]: I1014 13:22:50.796583 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: I1014 13:22:52.167981 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Startup probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]etcd ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [-]poststarthook/authorization.openshift.io-bootstrapclusterroles failed: reason withheld Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: livez check failed Oct 14 13:22:52.168058 master-0 kubenswrapper[4807]: I1014 13:22:52.168042 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:22:52.219910 master-0 kubenswrapper[4807]: I1014 13:22:52.219838 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-vmk66"] Oct 14 13:22:52.230230 master-0 kubenswrapper[4807]: W1014 13:22:52.230162 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b2dcab_f199_48f6_9446_305c78399647.slice/crio-b119fe2b1a88e7903eb938a3f544bd84c931e4f6907da4ad6ca0b70496be7e3c WatchSource:0}: Error finding container b119fe2b1a88e7903eb938a3f544bd84c931e4f6907da4ad6ca0b70496be7e3c: Status 404 returned error can't find the container with id b119fe2b1a88e7903eb938a3f544bd84c931e4f6907da4ad6ca0b70496be7e3c Oct 14 13:22:52.939266 master-0 kubenswrapper[4807]: I1014 13:22:52.939198 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmk66" event={"ID":"65b2dcab-f199-48f6-9446-305c78399647","Type":"ContainerStarted","Data":"b119fe2b1a88e7903eb938a3f544bd84c931e4f6907da4ad6ca0b70496be7e3c"} Oct 14 13:22:53.085114 master-0 kubenswrapper[4807]: I1014 13:22:53.084986 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podStartSLOduration=156.483525136 podStartE2EDuration="2m41.084945435s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:22:38.729304386 +0000 UTC m=+153.410606240" lastFinishedPulling="2025-10-14 13:22:43.330724715 +0000 UTC m=+158.012026539" observedRunningTime="2025-10-14 13:22:53.050878498 +0000 UTC m=+167.732180362" watchObservedRunningTime="2025-10-14 13:22:53.084945435 +0000 UTC m=+167.766247299" Oct 14 13:22:53.086993 master-0 kubenswrapper[4807]: I1014 13:22:53.086918 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-p5vjv"] Oct 14 13:22:53.095804 master-0 kubenswrapper[4807]: W1014 13:22:53.095744 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d751fa_69e4_4205_b368_4aa3167a71a9.slice/crio-467091d45f4adea64cbfa078bbdf09cddea099e97e4a6c9eea385061f8570c16 WatchSource:0}: Error finding container 467091d45f4adea64cbfa078bbdf09cddea099e97e4a6c9eea385061f8570c16: Status 404 returned error can't find the container with id 467091d45f4adea64cbfa078bbdf09cddea099e97e4a6c9eea385061f8570c16 Oct 14 13:22:53.170172 master-0 kubenswrapper[4807]: I1014 13:22:53.170101 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podStartSLOduration=152.748981934 podStartE2EDuration="2m40.170082083s" podCreationTimestamp="2025-10-14 13:20:13 +0000 UTC" firstStartedPulling="2025-10-14 13:22:38.743390614 +0000 UTC m=+153.424692458" lastFinishedPulling="2025-10-14 13:22:46.164490783 +0000 UTC m=+160.845792607" observedRunningTime="2025-10-14 13:22:53.16641594 +0000 UTC m=+167.847717804" watchObservedRunningTime="2025-10-14 13:22:53.170082083 +0000 UTC m=+167.851383917" Oct 14 13:22:53.560604 master-0 kubenswrapper[4807]: I1014 13:22:53.560537 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:53.565548 master-0 kubenswrapper[4807]: I1014 13:22:53.565502 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:22:53.944683 master-0 kubenswrapper[4807]: I1014 13:22:53.944607 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p5vjv" event={"ID":"43d751fa-69e4-4205-b368-4aa3167a71a9","Type":"ContainerStarted","Data":"467091d45f4adea64cbfa078bbdf09cddea099e97e4a6c9eea385061f8570c16"} Oct 14 13:22:54.950785 master-0 kubenswrapper[4807]: I1014 13:22:54.950713 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p5vjv" event={"ID":"43d751fa-69e4-4205-b368-4aa3167a71a9","Type":"ContainerStarted","Data":"281f70a237986ccd5be97bd99fd9f918518bbcfbb25766981cd46e2e8275a71b"} Oct 14 13:22:55.959224 master-0 kubenswrapper[4807]: I1014 13:22:55.959123 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-p5vjv" event={"ID":"43d751fa-69e4-4205-b368-4aa3167a71a9","Type":"ContainerStarted","Data":"33e5bba78e85b2cfad948ff1a209f0c20ecb32200725f69d53978a61239278aa"} Oct 14 13:22:56.968064 master-0 kubenswrapper[4807]: I1014 13:22:56.967956 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-vmk66" event={"ID":"65b2dcab-f199-48f6-9446-305c78399647","Type":"ContainerStarted","Data":"072237ecd831eed55b082095363b0ea1838901038fc0029802e755aebebae968"} Oct 14 13:22:57.667676 master-0 kubenswrapper[4807]: I1014 13:22:57.667551 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:57.673798 master-0 kubenswrapper[4807]: I1014 13:22:57.673761 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:22:57.873484 master-0 kubenswrapper[4807]: I1014 13:22:57.873331 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-vmk66" podStartSLOduration=161.825273177 podStartE2EDuration="2m45.873301365s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:22:52.233972626 +0000 UTC m=+166.915274450" lastFinishedPulling="2025-10-14 13:22:56.282000814 +0000 UTC m=+170.963302638" observedRunningTime="2025-10-14 13:22:57.873184902 +0000 UTC m=+172.554486806" watchObservedRunningTime="2025-10-14 13:22:57.873301365 +0000 UTC m=+172.554603249" Oct 14 13:22:57.874675 master-0 kubenswrapper[4807]: I1014 13:22:57.874593 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-p5vjv" podStartSLOduration=164.286886048 podStartE2EDuration="2m45.874584408s" podCreationTimestamp="2025-10-14 13:20:12 +0000 UTC" firstStartedPulling="2025-10-14 13:22:53.100611874 +0000 UTC m=+167.781913698" lastFinishedPulling="2025-10-14 13:22:54.688310194 +0000 UTC m=+169.369612058" observedRunningTime="2025-10-14 13:22:57.194962032 +0000 UTC m=+171.876263856" watchObservedRunningTime="2025-10-14 13:22:57.874584408 +0000 UTC m=+172.555886272" Oct 14 13:22:57.971911 master-0 kubenswrapper[4807]: I1014 13:22:57.971749 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:23:03.953641 master-0 kubenswrapper[4807]: I1014 13:23:03.953571 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Oct 14 13:23:03.954519 master-0 kubenswrapper[4807]: E1014 13:23:03.953780 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" containerName="installer" Oct 14 13:23:03.954519 master-0 kubenswrapper[4807]: I1014 13:23:03.953800 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" containerName="installer" Oct 14 13:23:03.954519 master-0 kubenswrapper[4807]: I1014 13:23:03.953895 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e0b616f-6bb0-4490-ae29-fcc199223dfc" containerName="installer" Oct 14 13:23:03.954881 master-0 kubenswrapper[4807]: I1014 13:23:03.954823 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:03.996057 master-0 kubenswrapper[4807]: I1014 13:23:03.995999 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-master-0"] Oct 14 13:23:04.106447 master-0 kubenswrapper[4807]: I1014 13:23:04.106316 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.106766 master-0 kubenswrapper[4807]: I1014 13:23:04.106616 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.207563 master-0 kubenswrapper[4807]: I1014 13:23:04.207233 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.207563 master-0 kubenswrapper[4807]: I1014 13:23:04.207369 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.207563 master-0 kubenswrapper[4807]: I1014 13:23:04.207435 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-resource-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.207980 master-0 kubenswrapper[4807]: I1014 13:23:04.207518 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/c6bb4d3d6bdbb62903356b2987e206d2-cert-dir\") pod \"openshift-kube-scheduler-master-0\" (UID: \"c6bb4d3d6bdbb62903356b2987e206d2\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.294837 master-0 kubenswrapper[4807]: I1014 13:23:04.294668 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:04.316618 master-0 kubenswrapper[4807]: W1014 13:23:04.316423 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6bb4d3d6bdbb62903356b2987e206d2.slice/crio-f12c60b2dcff07caaac25332ac4229fd8a85a1a0bd488a48d0bee533c47bd9cc WatchSource:0}: Error finding container f12c60b2dcff07caaac25332ac4229fd8a85a1a0bd488a48d0bee533c47bd9cc: Status 404 returned error can't find the container with id f12c60b2dcff07caaac25332ac4229fd8a85a1a0bd488a48d0bee533c47bd9cc Oct 14 13:23:05.006226 master-0 kubenswrapper[4807]: I1014 13:23:05.005531 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c6bb4d3d6bdbb62903356b2987e206d2","Type":"ContainerStarted","Data":"f12c60b2dcff07caaac25332ac4229fd8a85a1a0bd488a48d0bee533c47bd9cc"} Oct 14 13:23:05.009128 master-0 kubenswrapper[4807]: I1014 13:23:05.009092 4807 generic.go:334] "Generic (PLEG): container finished" podID="1e3b66b9-caf6-4445-b2b6-3117279ee481" containerID="a0875b329d9a5ee16bb0c0455d9f939cefa1d1cbb733d2eeb2bf87618d9bf535" exitCode=0 Oct 14 13:23:05.009329 master-0 kubenswrapper[4807]: I1014 13:23:05.009222 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-6-master-0" event={"ID":"1e3b66b9-caf6-4445-b2b6-3117279ee481","Type":"ContainerDied","Data":"a0875b329d9a5ee16bb0c0455d9f939cefa1d1cbb733d2eeb2bf87618d9bf535"} Oct 14 13:23:06.318382 master-0 kubenswrapper[4807]: I1014 13:23:06.318278 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:23:06.430876 master-0 kubenswrapper[4807]: I1014 13:23:06.430786 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir\") pod \"1e3b66b9-caf6-4445-b2b6-3117279ee481\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " Oct 14 13:23:06.430876 master-0 kubenswrapper[4807]: I1014 13:23:06.430830 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") pod \"1e3b66b9-caf6-4445-b2b6-3117279ee481\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " Oct 14 13:23:06.430876 master-0 kubenswrapper[4807]: I1014 13:23:06.430879 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock\") pod \"1e3b66b9-caf6-4445-b2b6-3117279ee481\" (UID: \"1e3b66b9-caf6-4445-b2b6-3117279ee481\") " Oct 14 13:23:06.431331 master-0 kubenswrapper[4807]: I1014 13:23:06.430953 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "1e3b66b9-caf6-4445-b2b6-3117279ee481" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:06.431331 master-0 kubenswrapper[4807]: I1014 13:23:06.431116 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock" (OuterVolumeSpecName: "var-lock") pod "1e3b66b9-caf6-4445-b2b6-3117279ee481" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:06.431533 master-0 kubenswrapper[4807]: I1014 13:23:06.431489 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:06.431533 master-0 kubenswrapper[4807]: I1014 13:23:06.431525 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1e3b66b9-caf6-4445-b2b6-3117279ee481-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:06.436500 master-0 kubenswrapper[4807]: I1014 13:23:06.436415 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "1e3b66b9-caf6-4445-b2b6-3117279ee481" (UID: "1e3b66b9-caf6-4445-b2b6-3117279ee481"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:23:06.532523 master-0 kubenswrapper[4807]: I1014 13:23:06.532312 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/1e3b66b9-caf6-4445-b2b6-3117279ee481-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:07.020224 master-0 kubenswrapper[4807]: I1014 13:23:07.020088 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/installer-6-master-0" event={"ID":"1e3b66b9-caf6-4445-b2b6-3117279ee481","Type":"ContainerDied","Data":"3e387b6eaad5591125dae309e1918f26519c969003e3c6c24a58d7626188af8b"} Oct 14 13:23:07.020224 master-0 kubenswrapper[4807]: I1014 13:23:07.020162 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e387b6eaad5591125dae309e1918f26519c969003e3c6c24a58d7626188af8b" Oct 14 13:23:07.020224 master-0 kubenswrapper[4807]: I1014 13:23:07.020165 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/installer-6-master-0" Oct 14 13:23:11.610682 master-0 kubenswrapper[4807]: I1014 13:23:11.610610 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0"] Oct 14 13:23:11.611153 master-0 kubenswrapper[4807]: E1014 13:23:11.610819 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" containerName="installer" Oct 14 13:23:11.611153 master-0 kubenswrapper[4807]: I1014 13:23:11.610839 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" containerName="installer" Oct 14 13:23:11.611153 master-0 kubenswrapper[4807]: I1014 13:23:11.610928 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="1e3b66b9-caf6-4445-b2b6-3117279ee481" containerName="installer" Oct 14 13:23:11.611377 master-0 kubenswrapper[4807]: I1014 13:23:11.611345 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:11.614504 master-0 kubenswrapper[4807]: I1014 13:23:11.614430 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"kube-root-ca.crt" Oct 14 13:23:11.615832 master-0 kubenswrapper[4807]: I1014 13:23:11.615785 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"default-dockercfg-kszsm" Oct 14 13:23:11.617898 master-0 kubenswrapper[4807]: I1014 13:23:11.617855 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-scheduler"/"openshift-service-ca.crt" Oct 14 13:23:11.626984 master-0 kubenswrapper[4807]: I1014 13:23:11.626933 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0"] Oct 14 13:23:11.692729 master-0 kubenswrapper[4807]: I1014 13:23:11.692618 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xljpd\" (UniqueName: \"kubernetes.io/projected/dff0dd3a-c061-40a6-9861-f67bd4416c34-kube-api-access-xljpd\") pod \"openshift-kube-scheduler-guard-master-0\" (UID: \"dff0dd3a-c061-40a6-9861-f67bd4416c34\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:11.793865 master-0 kubenswrapper[4807]: I1014 13:23:11.793743 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xljpd\" (UniqueName: \"kubernetes.io/projected/dff0dd3a-c061-40a6-9861-f67bd4416c34-kube-api-access-xljpd\") pod \"openshift-kube-scheduler-guard-master-0\" (UID: \"dff0dd3a-c061-40a6-9861-f67bd4416c34\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:11.824251 master-0 kubenswrapper[4807]: I1014 13:23:11.824153 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xljpd\" (UniqueName: \"kubernetes.io/projected/dff0dd3a-c061-40a6-9861-f67bd4416c34-kube-api-access-xljpd\") pod \"openshift-kube-scheduler-guard-master-0\" (UID: \"dff0dd3a-c061-40a6-9861-f67bd4416c34\") " pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:11.933965 master-0 kubenswrapper[4807]: I1014 13:23:11.933752 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:12.043877 master-0 kubenswrapper[4807]: I1014 13:23:12.043774 4807 generic.go:334] "Generic (PLEG): container finished" podID="c6bb4d3d6bdbb62903356b2987e206d2" containerID="b2dd040c4cf3fd2fc3dd4b2466fafc0bce0b44068ff4b5c0ee3be7e15ce93aa1" exitCode=0 Oct 14 13:23:12.044169 master-0 kubenswrapper[4807]: I1014 13:23:12.043868 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c6bb4d3d6bdbb62903356b2987e206d2","Type":"ContainerDied","Data":"b2dd040c4cf3fd2fc3dd4b2466fafc0bce0b44068ff4b5c0ee3be7e15ce93aa1"} Oct 14 13:23:12.457922 master-0 kubenswrapper[4807]: I1014 13:23:12.457856 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0"] Oct 14 13:23:12.465085 master-0 kubenswrapper[4807]: W1014 13:23:12.465041 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddff0dd3a_c061_40a6_9861_f67bd4416c34.slice/crio-3991cab8de32f2e2547bf330c5ab5c871be39cbd5665c4bc217eb5755ca53ba8 WatchSource:0}: Error finding container 3991cab8de32f2e2547bf330c5ab5c871be39cbd5665c4bc217eb5755ca53ba8: Status 404 returned error can't find the container with id 3991cab8de32f2e2547bf330c5ab5c871be39cbd5665c4bc217eb5755ca53ba8 Oct 14 13:23:12.701726 master-0 kubenswrapper[4807]: I1014 13:23:12.701685 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:23:12.706567 master-0 kubenswrapper[4807]: I1014 13:23:12.705896 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Oct 14 13:23:12.716623 master-0 kubenswrapper[4807]: I1014 13:23:12.716540 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"installer-8-master-0\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " pod="openshift-etcd/installer-8-master-0" Oct 14 13:23:12.720570 master-0 kubenswrapper[4807]: I1014 13:23:12.720517 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-xbs2c" Oct 14 13:23:12.728443 master-0 kubenswrapper[4807]: I1014 13:23:12.728388 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:23:13.053131 master-0 kubenswrapper[4807]: I1014 13:23:13.053049 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c6bb4d3d6bdbb62903356b2987e206d2","Type":"ContainerStarted","Data":"70a12b09298fa4c16d7bf11fda57c6d8602380e32986eed5b81e042e0aca5187"} Oct 14 13:23:13.053131 master-0 kubenswrapper[4807]: I1014 13:23:13.053105 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c6bb4d3d6bdbb62903356b2987e206d2","Type":"ContainerStarted","Data":"542cefc6acd2b16fbc93d6879a69a9b26d6fcd4fd72beb17a0616d629431c14c"} Oct 14 13:23:13.053131 master-0 kubenswrapper[4807]: I1014 13:23:13.053122 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" event={"ID":"c6bb4d3d6bdbb62903356b2987e206d2","Type":"ContainerStarted","Data":"c29efe845110705f2c4836ac42e8337e20bdaf18ae4599bc01e25c695a9a978a"} Oct 14 13:23:13.053868 master-0 kubenswrapper[4807]: I1014 13:23:13.053300 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:23:13.055948 master-0 kubenswrapper[4807]: I1014 13:23:13.055841 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" event={"ID":"dff0dd3a-c061-40a6-9861-f67bd4416c34","Type":"ContainerStarted","Data":"cfba271e54ee04d7b2998f9e54fa1f225f4d70282d5f1ccc6d65167b6960ba8f"} Oct 14 13:23:13.055948 master-0 kubenswrapper[4807]: I1014 13:23:13.055882 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" event={"ID":"dff0dd3a-c061-40a6-9861-f67bd4416c34","Type":"ContainerStarted","Data":"3991cab8de32f2e2547bf330c5ab5c871be39cbd5665c4bc217eb5755ca53ba8"} Oct 14 13:23:13.056259 master-0 kubenswrapper[4807]: I1014 13:23:13.056208 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:13.063183 master-0 kubenswrapper[4807]: I1014 13:23:13.063152 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" Oct 14 13:23:13.086454 master-0 kubenswrapper[4807]: I1014 13:23:13.086288 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" podStartSLOduration=10.086261814 podStartE2EDuration="10.086261814s" podCreationTimestamp="2025-10-14 13:23:03 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:13.084696424 +0000 UTC m=+187.765998288" watchObservedRunningTime="2025-10-14 13:23:13.086261814 +0000 UTC m=+187.767563678" Oct 14 13:23:13.112116 master-0 kubenswrapper[4807]: I1014 13:23:13.111976 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0" podStartSLOduration=2.111952407 podStartE2EDuration="2.111952407s" podCreationTimestamp="2025-10-14 13:23:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:13.109378182 +0000 UTC m=+187.790680046" watchObservedRunningTime="2025-10-14 13:23:13.111952407 +0000 UTC m=+187.793254241" Oct 14 13:23:13.185328 master-0 kubenswrapper[4807]: I1014 13:23:13.185256 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-8-master-0"] Oct 14 13:23:13.208495 master-0 kubenswrapper[4807]: W1014 13:23:13.208363 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod51884012_8236_469c_8c63_49c36027fe7e.slice/crio-b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f WatchSource:0}: Error finding container b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f: Status 404 returned error can't find the container with id b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f Oct 14 13:23:14.060754 master-0 kubenswrapper[4807]: I1014 13:23:14.060651 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-8-master-0" event={"ID":"51884012-8236-469c-8c63-49c36027fe7e","Type":"ContainerStarted","Data":"b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f"} Oct 14 13:23:16.070607 master-0 kubenswrapper[4807]: I1014 13:23:16.070531 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-8-master-0" event={"ID":"51884012-8236-469c-8c63-49c36027fe7e","Type":"ContainerStarted","Data":"9f352e089ae7d5ddd587993c4b28a89c562410e7fbacbbb0c99e1ed12edb0a45"} Oct 14 13:23:16.126566 master-0 kubenswrapper[4807]: I1014 13:23:16.126453 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-8-master-0" podStartSLOduration=130.234700087 podStartE2EDuration="2m12.126428768s" podCreationTimestamp="2025-10-14 13:21:04 +0000 UTC" firstStartedPulling="2025-10-14 13:23:13.211291867 +0000 UTC m=+187.892593691" lastFinishedPulling="2025-10-14 13:23:15.103020538 +0000 UTC m=+189.784322372" observedRunningTime="2025-10-14 13:23:16.125916835 +0000 UTC m=+190.807218689" watchObservedRunningTime="2025-10-14 13:23:16.126428768 +0000 UTC m=+190.807730622" Oct 14 13:23:17.778693 master-0 kubenswrapper[4807]: I1014 13:23:17.778636 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-76c4979bdc-mgff4" Oct 14 13:23:19.214707 master-0 kubenswrapper[4807]: I1014 13:23:19.214620 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-scheduler/openshift-kube-scheduler-guard-master-0"] Oct 14 13:23:21.373342 master-0 kubenswrapper[4807]: I1014 13:23:21.373249 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:23:24.787866 master-0 kubenswrapper[4807]: I1014 13:23:24.787770 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Oct 14 13:23:24.788795 master-0 kubenswrapper[4807]: I1014 13:23:24.788530 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:24.791896 master-0 kubenswrapper[4807]: I1014 13:23:24.791854 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Oct 14 13:23:24.792211 master-0 kubenswrapper[4807]: I1014 13:23:24.792132 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-p7d8w" Oct 14 13:23:24.805923 master-0 kubenswrapper[4807]: I1014 13:23:24.805846 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Oct 14 13:23:24.936420 master-0 kubenswrapper[4807]: I1014 13:23:24.936292 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:24.936420 master-0 kubenswrapper[4807]: I1014 13:23:24.936390 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:24.936420 master-0 kubenswrapper[4807]: I1014 13:23:24.936416 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.038250 master-0 kubenswrapper[4807]: I1014 13:23:25.038040 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.038250 master-0 kubenswrapper[4807]: I1014 13:23:25.038134 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.038250 master-0 kubenswrapper[4807]: I1014 13:23:25.038191 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.038707 master-0 kubenswrapper[4807]: I1014 13:23:25.038302 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.038707 master-0 kubenswrapper[4807]: I1014 13:23:25.038326 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.059603 master-0 kubenswrapper[4807]: I1014 13:23:25.059505 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access\") pod \"installer-5-master-0\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.106111 master-0 kubenswrapper[4807]: I1014 13:23:25.105998 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:23:25.190253 master-0 kubenswrapper[4807]: I1014 13:23:25.190145 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Oct 14 13:23:25.191120 master-0 kubenswrapper[4807]: I1014 13:23:25.191041 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.245177 master-0 kubenswrapper[4807]: I1014 13:23:25.245110 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-master-0"] Oct 14 13:23:25.343649 master-0 kubenswrapper[4807]: I1014 13:23:25.343530 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.343649 master-0 kubenswrapper[4807]: I1014 13:23:25.343640 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.444762 master-0 kubenswrapper[4807]: I1014 13:23:25.444613 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.444762 master-0 kubenswrapper[4807]: I1014 13:23:25.444715 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.445134 master-0 kubenswrapper[4807]: I1014 13:23:25.444796 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-resource-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.445134 master-0 kubenswrapper[4807]: I1014 13:23:25.444825 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/9b5e7d17add1c795402fccb23e9fe2ce-cert-dir\") pod \"kube-controller-manager-master-0\" (UID: \"9b5e7d17add1c795402fccb23e9fe2ce\") " pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.544002 master-0 kubenswrapper[4807]: I1014 13:23:25.543830 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:25.558175 master-0 kubenswrapper[4807]: W1014 13:23:25.558087 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5e7d17add1c795402fccb23e9fe2ce.slice/crio-f43b99aa72899637605a4c412bfcf2a1c18a1e54b27cdd7aba6490552647a0dc WatchSource:0}: Error finding container f43b99aa72899637605a4c412bfcf2a1c18a1e54b27cdd7aba6490552647a0dc: Status 404 returned error can't find the container with id f43b99aa72899637605a4c412bfcf2a1c18a1e54b27cdd7aba6490552647a0dc Oct 14 13:23:25.626685 master-0 kubenswrapper[4807]: I1014 13:23:25.626605 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-5-master-0"] Oct 14 13:23:25.634495 master-0 kubenswrapper[4807]: W1014 13:23:25.634383 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb24c3020_ee66_4cae_8319_d098cc328b20.slice/crio-4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a WatchSource:0}: Error finding container 4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a: Status 404 returned error can't find the container with id 4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a Oct 14 13:23:25.723653 master-0 kubenswrapper[4807]: I1014 13:23:25.721423 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-1"] Oct 14 13:23:25.723653 master-0 kubenswrapper[4807]: I1014 13:23:25.723632 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.728869 master-0 kubenswrapper[4807]: I1014 13:23:25.728795 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-z89cl" Oct 14 13:23:25.729069 master-0 kubenswrapper[4807]: I1014 13:23:25.729008 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Oct 14 13:23:25.729290 master-0 kubenswrapper[4807]: I1014 13:23:25.729271 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Oct 14 13:23:25.730204 master-0 kubenswrapper[4807]: I1014 13:23:25.730169 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Oct 14 13:23:25.730890 master-0 kubenswrapper[4807]: I1014 13:23:25.730242 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Oct 14 13:23:25.730959 master-0 kubenswrapper[4807]: I1014 13:23:25.730276 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Oct 14 13:23:25.730959 master-0 kubenswrapper[4807]: I1014 13:23:25.730391 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Oct 14 13:23:25.731055 master-0 kubenswrapper[4807]: I1014 13:23:25.730647 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Oct 14 13:23:25.738289 master-0 kubenswrapper[4807]: I1014 13:23:25.738250 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"alertmanager-trusted-ca-bundle" Oct 14 13:23:25.763746 master-0 kubenswrapper[4807]: I1014 13:23:25.759883 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-1"] Oct 14 13:23:25.848825 master-0 kubenswrapper[4807]: I1014 13:23:25.848720 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-tls-assets\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.848825 master-0 kubenswrapper[4807]: I1014 13:23:25.848806 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-main-tls\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.848825 master-0 kubenswrapper[4807]: I1014 13:23:25.848855 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.848889 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph664\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-kube-api-access-ph664\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849125 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849297 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849394 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-web-config\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849443 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849552 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-main-db\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849592 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-config-volume\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849613 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-config-out\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.851059 master-0 kubenswrapper[4807]: I1014 13:23:25.849658 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-metrics-client-ca\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950195 master-0 kubenswrapper[4807]: I1014 13:23:25.950077 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-tls-assets\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950195 master-0 kubenswrapper[4807]: I1014 13:23:25.950191 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-main-tls\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950237 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950284 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ph664\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-kube-api-access-ph664\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950327 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950366 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950405 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-web-config\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950443 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.950566 master-0 kubenswrapper[4807]: I1014 13:23:25.950503 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-main-db\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.952109 master-0 kubenswrapper[4807]: I1014 13:23:25.951553 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-config-volume\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.952109 master-0 kubenswrapper[4807]: I1014 13:23:25.951610 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-config-out\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.952109 master-0 kubenswrapper[4807]: I1014 13:23:25.951655 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-metrics-client-ca\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.952109 master-0 kubenswrapper[4807]: I1014 13:23:25.951681 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-main-db\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.952996 master-0 kubenswrapper[4807]: I1014 13:23:25.952826 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.953212 master-0 kubenswrapper[4807]: I1014 13:23:25.953154 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6055814d-fb43-4d86-9e50-5127255b5aa4-metrics-client-ca\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.955160 master-0 kubenswrapper[4807]: I1014 13:23:25.955071 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-main-tls\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.956111 master-0 kubenswrapper[4807]: I1014 13:23:25.956047 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.957427 master-0 kubenswrapper[4807]: I1014 13:23:25.956639 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-web-config\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.957427 master-0 kubenswrapper[4807]: I1014 13:23:25.956871 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-config-volume\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.957427 master-0 kubenswrapper[4807]: I1014 13:23:25.957087 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6055814d-fb43-4d86-9e50-5127255b5aa4-config-out\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.957427 master-0 kubenswrapper[4807]: I1014 13:23:25.957331 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.957771 master-0 kubenswrapper[4807]: I1014 13:23:25.957726 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-tls-assets\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.959810 master-0 kubenswrapper[4807]: I1014 13:23:25.959743 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6055814d-fb43-4d86-9e50-5127255b5aa4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:25.972293 master-0 kubenswrapper[4807]: I1014 13:23:25.972190 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph664\" (UniqueName: \"kubernetes.io/projected/6055814d-fb43-4d86-9e50-5127255b5aa4-kube-api-access-ph664\") pod \"alertmanager-main-1\" (UID: \"6055814d-fb43-4d86-9e50-5127255b5aa4\") " pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:26.073810 master-0 kubenswrapper[4807]: I1014 13:23:26.070011 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:26.120179 master-0 kubenswrapper[4807]: I1014 13:23:26.120044 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"b24c3020-ee66-4cae-8319-d098cc328b20","Type":"ContainerStarted","Data":"88e3a72f2158819ba3fdd0b4d3f05f6aeed1dd5bc7d773a52fa2189437592f4b"} Oct 14 13:23:26.120179 master-0 kubenswrapper[4807]: I1014 13:23:26.120146 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"b24c3020-ee66-4cae-8319-d098cc328b20","Type":"ContainerStarted","Data":"4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a"} Oct 14 13:23:26.122022 master-0 kubenswrapper[4807]: I1014 13:23:26.121962 4807 generic.go:334] "Generic (PLEG): container finished" podID="6a905fdc-a19f-4578-a4a3-100fbe944829" containerID="4220eebbbf98106aea65c744a9f3dc86e7ae558ecca28c1cd3ef3b4eefeef8ba" exitCode=0 Oct 14 13:23:26.122194 master-0 kubenswrapper[4807]: I1014 13:23:26.122049 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-6-master-0" event={"ID":"6a905fdc-a19f-4578-a4a3-100fbe944829","Type":"ContainerDied","Data":"4220eebbbf98106aea65c744a9f3dc86e7ae558ecca28c1cd3ef3b4eefeef8ba"} Oct 14 13:23:26.124017 master-0 kubenswrapper[4807]: I1014 13:23:26.123904 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"9b5e7d17add1c795402fccb23e9fe2ce","Type":"ContainerStarted","Data":"3072d997939f2de5de322189ed1e8e09c01c8ffc95964532f81fd2a9803d78dc"} Oct 14 13:23:26.124017 master-0 kubenswrapper[4807]: I1014 13:23:26.123977 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"9b5e7d17add1c795402fccb23e9fe2ce","Type":"ContainerStarted","Data":"f43b99aa72899637605a4c412bfcf2a1c18a1e54b27cdd7aba6490552647a0dc"} Oct 14 13:23:26.193223 master-0 kubenswrapper[4807]: I1014 13:23:26.193037 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-5-master-0" podStartSLOduration=2.193014119 podStartE2EDuration="2.193014119s" podCreationTimestamp="2025-10-14 13:23:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:26.189370116 +0000 UTC m=+200.870671940" watchObservedRunningTime="2025-10-14 13:23:26.193014119 +0000 UTC m=+200.874315953" Oct 14 13:23:26.511134 master-0 kubenswrapper[4807]: I1014 13:23:26.511083 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-1"] Oct 14 13:23:26.515538 master-0 kubenswrapper[4807]: W1014 13:23:26.515438 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6055814d_fb43_4d86_9e50_5127255b5aa4.slice/crio-2a572cbd852629b1a33935f58c84e41600add6f134c78bba36e5aa8c223c39ee WatchSource:0}: Error finding container 2a572cbd852629b1a33935f58c84e41600add6f134c78bba36e5aa8c223c39ee: Status 404 returned error can't find the container with id 2a572cbd852629b1a33935f58c84e41600add6f134c78bba36e5aa8c223c39ee Oct 14 13:23:27.129612 master-0 kubenswrapper[4807]: I1014 13:23:27.129534 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"2a572cbd852629b1a33935f58c84e41600add6f134c78bba36e5aa8c223c39ee"} Oct 14 13:23:28.457681 master-0 kubenswrapper[4807]: I1014 13:23:28.457633 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:23:28.582170 master-0 kubenswrapper[4807]: I1014 13:23:28.582046 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock\") pod \"6a905fdc-a19f-4578-a4a3-100fbe944829\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " Oct 14 13:23:28.582442 master-0 kubenswrapper[4807]: I1014 13:23:28.582221 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access\") pod \"6a905fdc-a19f-4578-a4a3-100fbe944829\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " Oct 14 13:23:28.582442 master-0 kubenswrapper[4807]: I1014 13:23:28.582247 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir\") pod \"6a905fdc-a19f-4578-a4a3-100fbe944829\" (UID: \"6a905fdc-a19f-4578-a4a3-100fbe944829\") " Oct 14 13:23:28.582442 master-0 kubenswrapper[4807]: I1014 13:23:28.582212 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock" (OuterVolumeSpecName: "var-lock") pod "6a905fdc-a19f-4578-a4a3-100fbe944829" (UID: "6a905fdc-a19f-4578-a4a3-100fbe944829"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:28.582850 master-0 kubenswrapper[4807]: I1014 13:23:28.582781 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:28.622818 master-0 kubenswrapper[4807]: I1014 13:23:28.585713 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "6a905fdc-a19f-4578-a4a3-100fbe944829" (UID: "6a905fdc-a19f-4578-a4a3-100fbe944829"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:23:28.663676 master-0 kubenswrapper[4807]: I1014 13:23:28.663437 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "6a905fdc-a19f-4578-a4a3-100fbe944829" (UID: "6a905fdc-a19f-4578-a4a3-100fbe944829"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:28.684025 master-0 kubenswrapper[4807]: I1014 13:23:28.683912 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a905fdc-a19f-4578-a4a3-100fbe944829-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:28.684025 master-0 kubenswrapper[4807]: I1014 13:23:28.683983 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a905fdc-a19f-4578-a4a3-100fbe944829-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:29.142882 master-0 kubenswrapper[4807]: I1014 13:23:29.142810 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/installer-6-master-0" event={"ID":"6a905fdc-a19f-4578-a4a3-100fbe944829","Type":"ContainerDied","Data":"5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473"} Oct 14 13:23:29.142882 master-0 kubenswrapper[4807]: I1014 13:23:29.142871 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5af6002d41db92cd5f9a5994568abd91d689765e32a8d77b7daccab792072473" Oct 14 13:23:29.142882 master-0 kubenswrapper[4807]: I1014 13:23:29.142874 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/installer-6-master-0" Oct 14 13:23:30.154179 master-0 kubenswrapper[4807]: I1014 13:23:30.154095 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"9b5e7d17add1c795402fccb23e9fe2ce","Type":"ContainerStarted","Data":"e4efe64543eecb5317fc89304d3ac901185c6c5c6b825db08dcbd6e26b1d6242"} Oct 14 13:23:30.154179 master-0 kubenswrapper[4807]: I1014 13:23:30.154148 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"9b5e7d17add1c795402fccb23e9fe2ce","Type":"ContainerStarted","Data":"2b63f4aa2de3d77f18a06e7a67877bb558a2fc61f219236508a1415519235cef"} Oct 14 13:23:30.154179 master-0 kubenswrapper[4807]: I1014 13:23:30.154158 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" event={"ID":"9b5e7d17add1c795402fccb23e9fe2ce","Type":"ContainerStarted","Data":"b364d58fdb2fbc9929463c18979603bb99bd714b5a4aa2ad74a7f3cd5bc4766f"} Oct 14 13:23:30.156401 master-0 kubenswrapper[4807]: I1014 13:23:30.156142 4807 generic.go:334] "Generic (PLEG): container finished" podID="6055814d-fb43-4d86-9e50-5127255b5aa4" containerID="100b69d77d3957d30f9c0201062f8e9ce011a4b416bbc7375acb1926f3cab2a7" exitCode=0 Oct 14 13:23:30.156401 master-0 kubenswrapper[4807]: I1014 13:23:30.156189 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerDied","Data":"100b69d77d3957d30f9c0201062f8e9ce011a4b416bbc7375acb1926f3cab2a7"} Oct 14 13:23:30.322072 master-0 kubenswrapper[4807]: I1014 13:23:30.321842 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" podStartSLOduration=5.321816834 podStartE2EDuration="5.321816834s" podCreationTimestamp="2025-10-14 13:23:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:30.321514727 +0000 UTC m=+205.002816591" watchObservedRunningTime="2025-10-14 13:23:30.321816834 +0000 UTC m=+205.003118658" Oct 14 13:23:30.737596 master-0 kubenswrapper[4807]: I1014 13:23:30.737526 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-guard-master-0"] Oct 14 13:23:30.738045 master-0 kubenswrapper[4807]: E1014 13:23:30.737697 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a905fdc-a19f-4578-a4a3-100fbe944829" containerName="installer" Oct 14 13:23:30.738045 master-0 kubenswrapper[4807]: I1014 13:23:30.737715 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a905fdc-a19f-4578-a4a3-100fbe944829" containerName="installer" Oct 14 13:23:30.738045 master-0 kubenswrapper[4807]: I1014 13:23:30.737787 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a905fdc-a19f-4578-a4a3-100fbe944829" containerName="installer" Oct 14 13:23:30.738218 master-0 kubenswrapper[4807]: I1014 13:23:30.738105 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:30.741409 master-0 kubenswrapper[4807]: I1014 13:23:30.741294 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-controller-manager"/"default-dockercfg-vv6lx" Oct 14 13:23:30.741409 master-0 kubenswrapper[4807]: I1014 13:23:30.741353 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"openshift-service-ca.crt" Oct 14 13:23:30.741972 master-0 kubenswrapper[4807]: I1014 13:23:30.741868 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-controller-manager"/"kube-root-ca.crt" Oct 14 13:23:30.801234 master-0 kubenswrapper[4807]: I1014 13:23:30.801136 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-vmk66" Oct 14 13:23:30.823447 master-0 kubenswrapper[4807]: I1014 13:23:30.823340 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-guard-master-0"] Oct 14 13:23:30.911497 master-0 kubenswrapper[4807]: I1014 13:23:30.911390 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fppck\" (UniqueName: \"kubernetes.io/projected/ca327f70-1fac-420d-94cb-7855751e2f81-kube-api-access-fppck\") pod \"kube-controller-manager-guard-master-0\" (UID: \"ca327f70-1fac-420d-94cb-7855751e2f81\") " pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:30.993979 master-0 kubenswrapper[4807]: I1014 13:23:30.993815 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-1"] Oct 14 13:23:30.995595 master-0 kubenswrapper[4807]: I1014 13:23:30.995549 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:30.998404 master-0 kubenswrapper[4807]: I1014 13:23:30.998356 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-web-config" Oct 14 13:23:30.998548 master-0 kubenswrapper[4807]: I1014 13:23:30.998476 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s" Oct 14 13:23:30.999405 master-0 kubenswrapper[4807]: I1014 13:23:30.999371 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-kube-rbac-proxy-web" Oct 14 13:23:30.999550 master-0 kubenswrapper[4807]: I1014 13:23:30.999507 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-dockercfg-dzg65" Oct 14 13:23:30.999550 master-0 kubenswrapper[4807]: I1014 13:23:30.999523 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls-assets-0" Oct 14 13:23:30.999669 master-0 kubenswrapper[4807]: I1014 13:23:30.999555 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-prometheus-http-client-file" Oct 14 13:23:30.999827 master-0 kubenswrapper[4807]: I1014 13:23:30.999800 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-tls" Oct 14 13:23:30.999873 master-0 kubenswrapper[4807]: I1014 13:23:30.999844 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-grpc-tls-8klgi7r2728qp" Oct 14 13:23:31.000001 master-0 kubenswrapper[4807]: I1014 13:23:30.999805 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"kube-rbac-proxy" Oct 14 13:23:31.000048 master-0 kubenswrapper[4807]: I1014 13:23:30.999993 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"prometheus-k8s-thanos-sidecar-tls" Oct 14 13:23:31.000163 master-0 kubenswrapper[4807]: I1014 13:23:31.000124 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"serving-certs-ca-bundle" Oct 14 13:23:31.005703 master-0 kubenswrapper[4807]: I1014 13:23:31.005669 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-k8s-rulefiles-0" Oct 14 13:23:31.008871 master-0 kubenswrapper[4807]: I1014 13:23:31.008825 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-monitoring"/"prometheus-trusted-ca-bundle" Oct 14 13:23:31.012445 master-0 kubenswrapper[4807]: I1014 13:23:31.012355 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012564 master-0 kubenswrapper[4807]: I1014 13:23:31.012521 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012614 master-0 kubenswrapper[4807]: I1014 13:23:31.012591 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012655 master-0 kubenswrapper[4807]: I1014 13:23:31.012638 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-grpc-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012715 master-0 kubenswrapper[4807]: I1014 13:23:31.012688 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012769 master-0 kubenswrapper[4807]: I1014 13:23:31.012740 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012833 master-0 kubenswrapper[4807]: I1014 13:23:31.012808 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-tls-assets\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012870 master-0 kubenswrapper[4807]: I1014 13:23:31.012852 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-db\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.012916 master-0 kubenswrapper[4807]: I1014 13:23:31.012891 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx4bp\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-kube-api-access-fx4bp\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013001 master-0 kubenswrapper[4807]: I1014 13:23:31.012974 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013051 master-0 kubenswrapper[4807]: I1014 13:23:31.013025 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013106 master-0 kubenswrapper[4807]: I1014 13:23:31.013079 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-config-out\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013169 master-0 kubenswrapper[4807]: I1014 13:23:31.013139 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013216 master-0 kubenswrapper[4807]: I1014 13:23:31.013195 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013285 master-0 kubenswrapper[4807]: I1014 13:23:31.013253 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fppck\" (UniqueName: \"kubernetes.io/projected/ca327f70-1fac-420d-94cb-7855751e2f81-kube-api-access-fppck\") pod \"kube-controller-manager-guard-master-0\" (UID: \"ca327f70-1fac-420d-94cb-7855751e2f81\") " pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:31.013335 master-0 kubenswrapper[4807]: I1014 13:23:31.013305 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-metrics-client-certs\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013394 master-0 kubenswrapper[4807]: I1014 13:23:31.013358 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013451 master-0 kubenswrapper[4807]: I1014 13:23:31.013421 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.013534 master-0 kubenswrapper[4807]: I1014 13:23:31.013509 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-web-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.021771 master-0 kubenswrapper[4807]: I1014 13:23:31.021549 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-1"] Oct 14 13:23:31.078570 master-0 kubenswrapper[4807]: I1014 13:23:31.078449 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fppck\" (UniqueName: \"kubernetes.io/projected/ca327f70-1fac-420d-94cb-7855751e2f81-kube-api-access-fppck\") pod \"kube-controller-manager-guard-master-0\" (UID: \"ca327f70-1fac-420d-94cb-7855751e2f81\") " pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:31.114853 master-0 kubenswrapper[4807]: I1014 13:23:31.114760 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.114853 master-0 kubenswrapper[4807]: I1014 13:23:31.114857 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115168 master-0 kubenswrapper[4807]: I1014 13:23:31.114902 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-web-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115168 master-0 kubenswrapper[4807]: I1014 13:23:31.114970 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115168 master-0 kubenswrapper[4807]: I1014 13:23:31.115014 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115168 master-0 kubenswrapper[4807]: I1014 13:23:31.115056 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115168 master-0 kubenswrapper[4807]: I1014 13:23:31.115090 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-grpc-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115340 master-0 kubenswrapper[4807]: I1014 13:23:31.115199 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115340 master-0 kubenswrapper[4807]: I1014 13:23:31.115306 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115419 master-0 kubenswrapper[4807]: I1014 13:23:31.115364 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-tls-assets\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115455 master-0 kubenswrapper[4807]: I1014 13:23:31.115410 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-db\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115515 master-0 kubenswrapper[4807]: I1014 13:23:31.115492 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fx4bp\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-kube-api-access-fx4bp\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115597 master-0 kubenswrapper[4807]: I1014 13:23:31.115547 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115703 master-0 kubenswrapper[4807]: I1014 13:23:31.115667 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115757 master-0 kubenswrapper[4807]: I1014 13:23:31.115719 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-config-out\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115800 master-0 kubenswrapper[4807]: I1014 13:23:31.115757 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115834 master-0 kubenswrapper[4807]: I1014 13:23:31.115795 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.115869 master-0 kubenswrapper[4807]: I1014 13:23:31.115840 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-metrics-client-certs\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.116517 master-0 kubenswrapper[4807]: I1014 13:23:31.116436 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.117074 master-0 kubenswrapper[4807]: I1014 13:23:31.117023 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-db\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.117127 master-0 kubenswrapper[4807]: I1014 13:23:31.117071 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.117820 master-0 kubenswrapper[4807]: I1014 13:23:31.117781 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.119183 master-0 kubenswrapper[4807]: I1014 13:23:31.119140 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-configmap-metrics-client-ca\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.119338 master-0 kubenswrapper[4807]: I1014 13:23:31.119298 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.120601 master-0 kubenswrapper[4807]: I1014 13:23:31.120550 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.121439 master-0 kubenswrapper[4807]: I1014 13:23:31.121377 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.122170 master-0 kubenswrapper[4807]: I1014 13:23:31.122115 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.122257 master-0 kubenswrapper[4807]: I1014 13:23:31.122192 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.122585 master-0 kubenswrapper[4807]: I1014 13:23:31.122541 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-web-config\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.122585 master-0 kubenswrapper[4807]: I1014 13:23:31.122575 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/939066aa-c4ea-48bf-97f8-5e2928c224f4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.123202 master-0 kubenswrapper[4807]: I1014 13:23:31.123155 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-metrics-client-certs\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.123685 master-0 kubenswrapper[4807]: I1014 13:23:31.123628 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-tls-assets\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.125193 master-0 kubenswrapper[4807]: I1014 13:23:31.125157 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/939066aa-c4ea-48bf-97f8-5e2928c224f4-config-out\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.126361 master-0 kubenswrapper[4807]: I1014 13:23:31.125671 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.126361 master-0 kubenswrapper[4807]: I1014 13:23:31.126330 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/939066aa-c4ea-48bf-97f8-5e2928c224f4-secret-grpc-tls\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.136639 master-0 kubenswrapper[4807]: I1014 13:23:31.136593 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx4bp\" (UniqueName: \"kubernetes.io/projected/939066aa-c4ea-48bf-97f8-5e2928c224f4-kube-api-access-fx4bp\") pod \"prometheus-k8s-1\" (UID: \"939066aa-c4ea-48bf-97f8-5e2928c224f4\") " pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.312179 master-0 kubenswrapper[4807]: I1014 13:23:31.312034 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:31.357773 master-0 kubenswrapper[4807]: I1014 13:23:31.357686 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:32.120151 master-0 kubenswrapper[4807]: I1014 13:23:32.120098 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-1"] Oct 14 13:23:32.124133 master-0 kubenswrapper[4807]: W1014 13:23:32.124080 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod939066aa_c4ea_48bf_97f8_5e2928c224f4.slice/crio-564dfcac9b0e0482890e76b22e89764c45f75295e96a2567df2ef999f994b1d4 WatchSource:0}: Error finding container 564dfcac9b0e0482890e76b22e89764c45f75295e96a2567df2ef999f994b1d4: Status 404 returned error can't find the container with id 564dfcac9b0e0482890e76b22e89764c45f75295e96a2567df2ef999f994b1d4 Oct 14 13:23:32.142297 master-0 kubenswrapper[4807]: I1014 13:23:32.142258 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-guard-master-0"] Oct 14 13:23:32.170241 master-0 kubenswrapper[4807]: I1014 13:23:32.170191 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"22a846df1923c900bd27d5917109913ba3af8047dcb6bb69f1d1c5555afa014e"} Oct 14 13:23:32.170241 master-0 kubenswrapper[4807]: I1014 13:23:32.170243 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"bd5ea8f5ec9de9f6ca86695bba292df5852bb8195bc6c456124873cd947ebaec"} Oct 14 13:23:32.171514 master-0 kubenswrapper[4807]: I1014 13:23:32.171479 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" event={"ID":"ca327f70-1fac-420d-94cb-7855751e2f81","Type":"ContainerStarted","Data":"61452f980ff8a9b9a06386dabb886c61f8ff28272a73c67c1a775f36563fc973"} Oct 14 13:23:32.172448 master-0 kubenswrapper[4807]: I1014 13:23:32.172399 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"564dfcac9b0e0482890e76b22e89764c45f75295e96a2567df2ef999f994b1d4"} Oct 14 13:23:33.182758 master-0 kubenswrapper[4807]: I1014 13:23:33.182687 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"e2a8f21a0c13d54ed501026722e36decda6517f9539abafeb27d987fa667959b"} Oct 14 13:23:33.182758 master-0 kubenswrapper[4807]: I1014 13:23:33.182751 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"1d06fba1cd9cbb5d3ecbfbb1b5e3801da094210276c9b57f88f9945aae2f8422"} Oct 14 13:23:33.182758 master-0 kubenswrapper[4807]: I1014 13:23:33.182767 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"d21c1852d01db4efc0d14895e97b7308abfe590fb60bb2ec10c76cbe2ccb6329"} Oct 14 13:23:33.188269 master-0 kubenswrapper[4807]: I1014 13:23:33.188218 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" event={"ID":"ca327f70-1fac-420d-94cb-7855751e2f81","Type":"ContainerStarted","Data":"c7b7c947c34fb78dd884b219db857a2ae987b2c57f48e6e401347e2439f706e4"} Oct 14 13:23:33.189840 master-0 kubenswrapper[4807]: I1014 13:23:33.189772 4807 generic.go:334] "Generic (PLEG): container finished" podID="939066aa-c4ea-48bf-97f8-5e2928c224f4" containerID="94178b6520d930a143b48ca9b73864b9ed5aab7b5fa87529173c34662f04bcfc" exitCode=0 Oct 14 13:23:33.189935 master-0 kubenswrapper[4807]: I1014 13:23:33.189853 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerDied","Data":"94178b6520d930a143b48ca9b73864b9ed5aab7b5fa87529173c34662f04bcfc"} Oct 14 13:23:33.270896 master-0 kubenswrapper[4807]: I1014 13:23:33.270683 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" podStartSLOduration=3.270651503 podStartE2EDuration="3.270651503s" podCreationTimestamp="2025-10-14 13:23:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:33.269071603 +0000 UTC m=+207.950373467" watchObservedRunningTime="2025-10-14 13:23:33.270651503 +0000 UTC m=+207.951953417" Oct 14 13:23:34.199566 master-0 kubenswrapper[4807]: I1014 13:23:34.199426 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-1" event={"ID":"6055814d-fb43-4d86-9e50-5127255b5aa4","Type":"ContainerStarted","Data":"530f1aee80b70422092329175d4addb5d8892a972de8b4ae9727ea20009cec81"} Oct 14 13:23:34.200436 master-0 kubenswrapper[4807]: I1014 13:23:34.199659 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:34.205650 master-0 kubenswrapper[4807]: I1014 13:23:34.205600 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-guard-master-0" Oct 14 13:23:34.257924 master-0 kubenswrapper[4807]: I1014 13:23:34.257800 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-1" podStartSLOduration=2.325292003 podStartE2EDuration="9.25776829s" podCreationTimestamp="2025-10-14 13:23:25 +0000 UTC" firstStartedPulling="2025-10-14 13:23:26.520396466 +0000 UTC m=+201.201698300" lastFinishedPulling="2025-10-14 13:23:33.452872723 +0000 UTC m=+208.134174587" observedRunningTime="2025-10-14 13:23:34.257414351 +0000 UTC m=+208.938716185" watchObservedRunningTime="2025-10-14 13:23:34.25776829 +0000 UTC m=+208.939070104" Oct 14 13:23:35.552054 master-0 kubenswrapper[4807]: I1014 13:23:35.551942 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:35.552917 master-0 kubenswrapper[4807]: I1014 13:23:35.552687 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:35.552917 master-0 kubenswrapper[4807]: I1014 13:23:35.552734 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:35.552917 master-0 kubenswrapper[4807]: I1014 13:23:35.552747 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:35.557083 master-0 kubenswrapper[4807]: I1014 13:23:35.556983 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:35.557994 master-0 kubenswrapper[4807]: I1014 13:23:35.557943 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:36.071051 master-0 kubenswrapper[4807]: I1014 13:23:36.070941 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:36.216560 master-0 kubenswrapper[4807]: I1014 13:23:36.216516 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:37.216355 master-0 kubenswrapper[4807]: I1014 13:23:37.216178 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"4fab6eb11fdd692c215098a81e974a1a490020ed5f024336e5444b0533495ee9"} Oct 14 13:23:37.216355 master-0 kubenswrapper[4807]: I1014 13:23:37.216231 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"9046e63beb53c8bb52424a5cf3e467a8ebdac399ab3bd4e88b1381da54e1ed5e"} Oct 14 13:23:39.229990 master-0 kubenswrapper[4807]: I1014 13:23:39.229909 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"df0f053ce5b506f6c614a327c1294792d6b6ae8dde72f075b7b527d83f1f8a30"} Oct 14 13:23:39.229990 master-0 kubenswrapper[4807]: I1014 13:23:39.229977 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"ff245b9d6a2c453a8b56ca581c42e96c81cf9ea75f70e3885a3ac0974be5d5ea"} Oct 14 13:23:40.243430 master-0 kubenswrapper[4807]: I1014 13:23:40.243359 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"14069eb93242d06c0cafff20781bab051cde0395b3a2c9da9d4de167593fc43d"} Oct 14 13:23:40.243430 master-0 kubenswrapper[4807]: I1014 13:23:40.243413 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-1" event={"ID":"939066aa-c4ea-48bf-97f8-5e2928c224f4","Type":"ContainerStarted","Data":"d457b5f69e10675712144dbcbe1439749273fbbeebcdf26bd90dda17e76ea8de"} Oct 14 13:23:40.295862 master-0 kubenswrapper[4807]: I1014 13:23:40.295726 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-1" podStartSLOduration=4.759454594 podStartE2EDuration="10.295702348s" podCreationTimestamp="2025-10-14 13:23:30 +0000 UTC" firstStartedPulling="2025-10-14 13:23:33.191879827 +0000 UTC m=+207.873181651" lastFinishedPulling="2025-10-14 13:23:38.728127571 +0000 UTC m=+213.409429405" observedRunningTime="2025-10-14 13:23:40.292281591 +0000 UTC m=+214.973583465" watchObservedRunningTime="2025-10-14 13:23:40.295702348 +0000 UTC m=+214.977004212" Oct 14 13:23:41.313207 master-0 kubenswrapper[4807]: I1014 13:23:41.313111 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:23:43.007160 master-0 kubenswrapper[4807]: I1014 13:23:43.007065 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-controller-manager/kube-controller-manager-guard-master-0"] Oct 14 13:23:45.550526 master-0 kubenswrapper[4807]: I1014 13:23:45.550420 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-controller-manager/kube-controller-manager-master-0" Oct 14 13:23:46.427959 master-0 kubenswrapper[4807]: I1014 13:23:46.427857 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-554dc689f9-rnmmd" podUID="15467de3-2646-47a5-92e4-19140a65d17f" containerName="console" containerID="cri-o://3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8" gracePeriod=15 Oct 14 13:23:46.696646 master-0 kubenswrapper[4807]: I1014 13:23:46.696485 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:23:46.698829 master-0 kubenswrapper[4807]: I1014 13:23:46.698781 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.767178 master-0 kubenswrapper[4807]: I1014 13:23:46.767083 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:23:46.826037 master-0 kubenswrapper[4807]: I1014 13:23:46.825960 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.826523 master-0 kubenswrapper[4807]: I1014 13:23:46.826481 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.826799 master-0 kubenswrapper[4807]: I1014 13:23:46.826763 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.827018 master-0 kubenswrapper[4807]: I1014 13:23:46.826989 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.827219 master-0 kubenswrapper[4807]: I1014 13:23:46.827190 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.827411 master-0 kubenswrapper[4807]: I1014 13:23:46.827377 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929658 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929733 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929801 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929845 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929880 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.929918 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930017 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930087 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930131 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930173 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930234 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.930827 master-0 kubenswrapper[4807]: I1014 13:23:46.930290 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin\") pod \"etcd-master-0\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:23:46.950824 master-0 kubenswrapper[4807]: I1014 13:23:46.950696 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-554dc689f9-rnmmd_15467de3-2646-47a5-92e4-19140a65d17f/console/0.log" Oct 14 13:23:46.950824 master-0 kubenswrapper[4807]: I1014 13:23:46.950802 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:23:47.062685 master-0 kubenswrapper[4807]: I1014 13:23:47.061869 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:47.085671 master-0 kubenswrapper[4807]: W1014 13:23:47.085597 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7e53a8977ce5fc5588aef94f91dcc24.slice/crio-8cfb14c49f3104e7b86d6b02abce60aa06d0dd4ebbf2d61b3a861b165e3aefc8 WatchSource:0}: Error finding container 8cfb14c49f3104e7b86d6b02abce60aa06d0dd4ebbf2d61b3a861b165e3aefc8: Status 404 returned error can't find the container with id 8cfb14c49f3104e7b86d6b02abce60aa06d0dd4ebbf2d61b3a861b165e3aefc8 Oct 14 13:23:47.133182 master-0 kubenswrapper[4807]: I1014 13:23:47.133105 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srhxp\" (UniqueName: \"kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133348 master-0 kubenswrapper[4807]: I1014 13:23:47.133204 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133348 master-0 kubenswrapper[4807]: I1014 13:23:47.133245 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133348 master-0 kubenswrapper[4807]: I1014 13:23:47.133286 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133756 master-0 kubenswrapper[4807]: I1014 13:23:47.133393 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133986 master-0 kubenswrapper[4807]: I1014 13:23:47.133934 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.133986 master-0 kubenswrapper[4807]: I1014 13:23:47.133974 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert\") pod \"15467de3-2646-47a5-92e4-19140a65d17f\" (UID: \"15467de3-2646-47a5-92e4-19140a65d17f\") " Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.134368 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config" (OuterVolumeSpecName: "console-config") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.134490 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.135036 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.135088 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca" (OuterVolumeSpecName: "service-ca") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.135116 4807 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-console-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.135424 master-0 kubenswrapper[4807]: I1014 13:23:47.135190 4807 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.138350 master-0 kubenswrapper[4807]: I1014 13:23:47.138223 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp" (OuterVolumeSpecName: "kube-api-access-srhxp") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "kube-api-access-srhxp". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:23:47.138503 master-0 kubenswrapper[4807]: I1014 13:23:47.138441 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:23:47.139557 master-0 kubenswrapper[4807]: I1014 13:23:47.139501 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "15467de3-2646-47a5-92e4-19140a65d17f" (UID: "15467de3-2646-47a5-92e4-19140a65d17f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:23:47.236815 master-0 kubenswrapper[4807]: I1014 13:23:47.236567 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-srhxp\" (UniqueName: \"kubernetes.io/projected/15467de3-2646-47a5-92e4-19140a65d17f-kube-api-access-srhxp\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.236815 master-0 kubenswrapper[4807]: I1014 13:23:47.236642 4807 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.236815 master-0 kubenswrapper[4807]: I1014 13:23:47.236661 4807 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/15467de3-2646-47a5-92e4-19140a65d17f-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.236815 master-0 kubenswrapper[4807]: I1014 13:23:47.236683 4807 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-service-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.236815 master-0 kubenswrapper[4807]: I1014 13:23:47.236710 4807 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/15467de3-2646-47a5-92e4-19140a65d17f-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:47.285531 master-0 kubenswrapper[4807]: I1014 13:23:47.285410 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"8cfb14c49f3104e7b86d6b02abce60aa06d0dd4ebbf2d61b3a861b165e3aefc8"} Oct 14 13:23:47.287891 master-0 kubenswrapper[4807]: I1014 13:23:47.287863 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-554dc689f9-rnmmd_15467de3-2646-47a5-92e4-19140a65d17f/console/0.log" Oct 14 13:23:47.288018 master-0 kubenswrapper[4807]: I1014 13:23:47.287911 4807 generic.go:334] "Generic (PLEG): container finished" podID="15467de3-2646-47a5-92e4-19140a65d17f" containerID="3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8" exitCode=2 Oct 14 13:23:47.288018 master-0 kubenswrapper[4807]: I1014 13:23:47.287962 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554dc689f9-rnmmd" event={"ID":"15467de3-2646-47a5-92e4-19140a65d17f","Type":"ContainerDied","Data":"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8"} Oct 14 13:23:47.288018 master-0 kubenswrapper[4807]: I1014 13:23:47.287982 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-554dc689f9-rnmmd" event={"ID":"15467de3-2646-47a5-92e4-19140a65d17f","Type":"ContainerDied","Data":"08d10eb2607e7d3bf12c88dd24d77ed0f43885657e28eb47cd7d8e48f314c93d"} Oct 14 13:23:47.288018 master-0 kubenswrapper[4807]: I1014 13:23:47.288007 4807 scope.go:117] "RemoveContainer" containerID="3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8" Oct 14 13:23:47.288018 master-0 kubenswrapper[4807]: I1014 13:23:47.288016 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-554dc689f9-rnmmd" Oct 14 13:23:47.290605 master-0 kubenswrapper[4807]: I1014 13:23:47.290579 4807 generic.go:334] "Generic (PLEG): container finished" podID="51884012-8236-469c-8c63-49c36027fe7e" containerID="9f352e089ae7d5ddd587993c4b28a89c562410e7fbacbbb0c99e1ed12edb0a45" exitCode=0 Oct 14 13:23:47.290605 master-0 kubenswrapper[4807]: I1014 13:23:47.290606 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-8-master-0" event={"ID":"51884012-8236-469c-8c63-49c36027fe7e","Type":"ContainerDied","Data":"9f352e089ae7d5ddd587993c4b28a89c562410e7fbacbbb0c99e1ed12edb0a45"} Oct 14 13:23:47.305255 master-0 kubenswrapper[4807]: I1014 13:23:47.305186 4807 scope.go:117] "RemoveContainer" containerID="3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8" Oct 14 13:23:47.305899 master-0 kubenswrapper[4807]: E1014 13:23:47.305844 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8\": container with ID starting with 3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8 not found: ID does not exist" containerID="3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8" Oct 14 13:23:47.305980 master-0 kubenswrapper[4807]: I1014 13:23:47.305906 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8"} err="failed to get container status \"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8\": rpc error: code = NotFound desc = could not find container \"3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8\": container with ID starting with 3e85b19c3f480c0c601eeafa43cb24691d6b7a3d50e4b42ee6a9ced9c32059b8 not found: ID does not exist" Oct 14 13:23:47.353925 master-0 kubenswrapper[4807]: I1014 13:23:47.353785 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:23:47.363421 master-0 kubenswrapper[4807]: I1014 13:23:47.363313 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-554dc689f9-rnmmd"] Oct 14 13:23:48.269841 master-0 kubenswrapper[4807]: I1014 13:23:48.269700 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15467de3-2646-47a5-92e4-19140a65d17f" path="/var/lib/kubelet/pods/15467de3-2646-47a5-92e4-19140a65d17f/volumes" Oct 14 13:23:48.631364 master-0 kubenswrapper[4807]: I1014 13:23:48.631315 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:23:48.754052 master-0 kubenswrapper[4807]: I1014 13:23:48.753878 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock\") pod \"51884012-8236-469c-8c63-49c36027fe7e\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " Oct 14 13:23:48.754052 master-0 kubenswrapper[4807]: I1014 13:23:48.753945 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir\") pod \"51884012-8236-469c-8c63-49c36027fe7e\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " Oct 14 13:23:48.754052 master-0 kubenswrapper[4807]: I1014 13:23:48.753999 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") pod \"51884012-8236-469c-8c63-49c36027fe7e\" (UID: \"51884012-8236-469c-8c63-49c36027fe7e\") " Oct 14 13:23:48.754052 master-0 kubenswrapper[4807]: I1014 13:23:48.754007 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock" (OuterVolumeSpecName: "var-lock") pod "51884012-8236-469c-8c63-49c36027fe7e" (UID: "51884012-8236-469c-8c63-49c36027fe7e"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:48.754555 master-0 kubenswrapper[4807]: I1014 13:23:48.754067 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "51884012-8236-469c-8c63-49c36027fe7e" (UID: "51884012-8236-469c-8c63-49c36027fe7e"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:23:48.754555 master-0 kubenswrapper[4807]: I1014 13:23:48.754234 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:48.754555 master-0 kubenswrapper[4807]: I1014 13:23:48.754256 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/51884012-8236-469c-8c63-49c36027fe7e-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:48.757530 master-0 kubenswrapper[4807]: I1014 13:23:48.757500 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "51884012-8236-469c-8c63-49c36027fe7e" (UID: "51884012-8236-469c-8c63-49c36027fe7e"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:23:48.855535 master-0 kubenswrapper[4807]: I1014 13:23:48.855438 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/51884012-8236-469c-8c63-49c36027fe7e-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:23:49.308255 master-0 kubenswrapper[4807]: I1014 13:23:49.308169 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-8-master-0" event={"ID":"51884012-8236-469c-8c63-49c36027fe7e","Type":"ContainerDied","Data":"b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f"} Oct 14 13:23:49.308255 master-0 kubenswrapper[4807]: I1014 13:23:49.308244 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b6d01dd2cdb32cd04f1fcee30508da085d3ea0424520414b0b6d2b63d24fb44f" Oct 14 13:23:49.309066 master-0 kubenswrapper[4807]: I1014 13:23:49.308277 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-8-master-0" Oct 14 13:23:50.316915 master-0 kubenswrapper[4807]: I1014 13:23:50.316846 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413" exitCode=0 Oct 14 13:23:50.316915 master-0 kubenswrapper[4807]: I1014 13:23:50.316919 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerDied","Data":"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413"} Oct 14 13:23:51.326728 master-0 kubenswrapper[4807]: I1014 13:23:51.325619 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1" exitCode=0 Oct 14 13:23:51.326728 master-0 kubenswrapper[4807]: I1014 13:23:51.325692 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerDied","Data":"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1"} Oct 14 13:23:52.334885 master-0 kubenswrapper[4807]: I1014 13:23:52.334307 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76" exitCode=0 Oct 14 13:23:52.334885 master-0 kubenswrapper[4807]: I1014 13:23:52.334412 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerDied","Data":"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76"} Oct 14 13:23:53.343790 master-0 kubenswrapper[4807]: I1014 13:23:53.343730 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/0.log" Oct 14 13:23:53.355918 master-0 kubenswrapper[4807]: I1014 13:23:53.345340 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="c51c6dff2bcfbbc44e823fd9948f35130712fa275b26c1c5f24ee303f0b63a0a" exitCode=1 Oct 14 13:23:53.355918 master-0 kubenswrapper[4807]: I1014 13:23:53.345387 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff"} Oct 14 13:23:53.355918 master-0 kubenswrapper[4807]: I1014 13:23:53.345425 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerDied","Data":"c51c6dff2bcfbbc44e823fd9948f35130712fa275b26c1c5f24ee303f0b63a0a"} Oct 14 13:23:53.355918 master-0 kubenswrapper[4807]: I1014 13:23:53.345441 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3"} Oct 14 13:23:54.359252 master-0 kubenswrapper[4807]: I1014 13:23:54.359145 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/0.log" Oct 14 13:23:54.361732 master-0 kubenswrapper[4807]: I1014 13:23:54.361678 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1"} Oct 14 13:23:54.361860 master-0 kubenswrapper[4807]: I1014 13:23:54.361741 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a"} Oct 14 13:23:54.362732 master-0 kubenswrapper[4807]: I1014 13:23:54.362698 4807 scope.go:117] "RemoveContainer" containerID="c51c6dff2bcfbbc44e823fd9948f35130712fa275b26c1c5f24ee303f0b63a0a" Oct 14 13:23:54.384800 master-0 kubenswrapper[4807]: I1014 13:23:54.384695 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: E1014 13:23:54.384901 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="51884012-8236-469c-8c63-49c36027fe7e" containerName="installer" Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: I1014 13:23:54.384919 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="51884012-8236-469c-8c63-49c36027fe7e" containerName="installer" Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: E1014 13:23:54.384945 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="15467de3-2646-47a5-92e4-19140a65d17f" containerName="console" Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: I1014 13:23:54.384955 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="15467de3-2646-47a5-92e4-19140a65d17f" containerName="console" Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: I1014 13:23:54.385038 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="15467de3-2646-47a5-92e4-19140a65d17f" containerName="console" Oct 14 13:23:54.385211 master-0 kubenswrapper[4807]: I1014 13:23:54.385061 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="51884012-8236-469c-8c63-49c36027fe7e" containerName="installer" Oct 14 13:23:54.386162 master-0 kubenswrapper[4807]: I1014 13:23:54.385772 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.389957 master-0 kubenswrapper[4807]: I1014 13:23:54.389908 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Oct 14 13:23:54.393646 master-0 kubenswrapper[4807]: I1014 13:23:54.393593 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Oct 14 13:23:54.394126 master-0 kubenswrapper[4807]: I1014 13:23:54.394079 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Oct 14 13:23:54.394553 master-0 kubenswrapper[4807]: I1014 13:23:54.394506 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Oct 14 13:23:54.394553 master-0 kubenswrapper[4807]: I1014 13:23:54.394528 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Oct 14 13:23:54.394781 master-0 kubenswrapper[4807]: I1014 13:23:54.394693 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-r2r7j" Oct 14 13:23:54.394781 master-0 kubenswrapper[4807]: I1014 13:23:54.394747 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Oct 14 13:23:54.395297 master-0 kubenswrapper[4807]: I1014 13:23:54.395251 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Oct 14 13:23:54.414706 master-0 kubenswrapper[4807]: I1014 13:23:54.414624 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Oct 14 13:23:54.418011 master-0 kubenswrapper[4807]: I1014 13:23:54.417947 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:23:54.526227 master-0 kubenswrapper[4807]: I1014 13:23:54.526127 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526227 master-0 kubenswrapper[4807]: I1014 13:23:54.526203 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5p62\" (UniqueName: \"kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526227 master-0 kubenswrapper[4807]: I1014 13:23:54.526232 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526665 master-0 kubenswrapper[4807]: I1014 13:23:54.526276 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526665 master-0 kubenswrapper[4807]: I1014 13:23:54.526300 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526665 master-0 kubenswrapper[4807]: I1014 13:23:54.526325 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.526665 master-0 kubenswrapper[4807]: I1014 13:23:54.526360 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.627879 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.627974 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v5p62\" (UniqueName: \"kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.628032 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.628119 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.628162 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.628221 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.628582 master-0 kubenswrapper[4807]: I1014 13:23:54.628291 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.631991 master-0 kubenswrapper[4807]: I1014 13:23:54.630534 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.631991 master-0 kubenswrapper[4807]: I1014 13:23:54.630612 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.631991 master-0 kubenswrapper[4807]: I1014 13:23:54.630759 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.631991 master-0 kubenswrapper[4807]: I1014 13:23:54.631920 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.633903 master-0 kubenswrapper[4807]: I1014 13:23:54.633035 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.634677 master-0 kubenswrapper[4807]: I1014 13:23:54.634081 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.672813 master-0 kubenswrapper[4807]: I1014 13:23:54.672718 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5p62\" (UniqueName: \"kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62\") pod \"console-77d8f866f9-8jlq8\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:54.733933 master-0 kubenswrapper[4807]: I1014 13:23:54.733781 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:23:55.191791 master-0 kubenswrapper[4807]: I1014 13:23:55.191586 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:23:55.201829 master-0 kubenswrapper[4807]: W1014 13:23:55.201728 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30903b96_1916_42f4_a30f_5d962ea7c386.slice/crio-2f3ca8355e71f452eeaa30571b5bd12384f60fd4c023f9e5670103a589a96b99 WatchSource:0}: Error finding container 2f3ca8355e71f452eeaa30571b5bd12384f60fd4c023f9e5670103a589a96b99: Status 404 returned error can't find the container with id 2f3ca8355e71f452eeaa30571b5bd12384f60fd4c023f9e5670103a589a96b99 Oct 14 13:23:55.374373 master-0 kubenswrapper[4807]: I1014 13:23:55.374298 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:23:55.377589 master-0 kubenswrapper[4807]: I1014 13:23:55.377455 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/0.log" Oct 14 13:23:55.380288 master-0 kubenswrapper[4807]: I1014 13:23:55.380200 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" exitCode=1 Oct 14 13:23:55.380444 master-0 kubenswrapper[4807]: I1014 13:23:55.380283 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerDied","Data":"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776"} Oct 14 13:23:55.380444 master-0 kubenswrapper[4807]: I1014 13:23:55.380371 4807 scope.go:117] "RemoveContainer" containerID="c51c6dff2bcfbbc44e823fd9948f35130712fa275b26c1c5f24ee303f0b63a0a" Oct 14 13:23:55.381166 master-0 kubenswrapper[4807]: I1014 13:23:55.381113 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:23:55.381622 master-0 kubenswrapper[4807]: E1014 13:23:55.381568 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 10s restarting failed container=etcd pod=etcd-master-0_openshift-etcd(a7e53a8977ce5fc5588aef94f91dcc24)\"" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" Oct 14 13:23:55.383225 master-0 kubenswrapper[4807]: I1014 13:23:55.383111 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d8f866f9-8jlq8" event={"ID":"30903b96-1916-42f4-a30f-5d962ea7c386","Type":"ContainerStarted","Data":"b8fdd5da1e3d5f8df8bec78d70dc8c884fb3218a640447a571e6f65d706ee529"} Oct 14 13:23:55.383334 master-0 kubenswrapper[4807]: I1014 13:23:55.383226 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d8f866f9-8jlq8" event={"ID":"30903b96-1916-42f4-a30f-5d962ea7c386","Type":"ContainerStarted","Data":"2f3ca8355e71f452eeaa30571b5bd12384f60fd4c023f9e5670103a589a96b99"} Oct 14 13:23:55.488364 master-0 kubenswrapper[4807]: I1014 13:23:55.488104 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-77d8f866f9-8jlq8" podStartSLOduration=34.488072032 podStartE2EDuration="34.488072032s" podCreationTimestamp="2025-10-14 13:23:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:23:55.485590209 +0000 UTC m=+230.166892053" watchObservedRunningTime="2025-10-14 13:23:55.488072032 +0000 UTC m=+230.169373886" Oct 14 13:23:56.111388 master-0 kubenswrapper[4807]: I1014 13:23:56.111292 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/alertmanager-main-1" Oct 14 13:23:56.390300 master-0 kubenswrapper[4807]: I1014 13:23:56.390148 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:23:56.396870 master-0 kubenswrapper[4807]: I1014 13:23:56.396766 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:23:56.397363 master-0 kubenswrapper[4807]: E1014 13:23:56.397269 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 10s restarting failed container=etcd pod=etcd-master-0_openshift-etcd(a7e53a8977ce5fc5588aef94f91dcc24)\"" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" Oct 14 13:23:57.062409 master-0 kubenswrapper[4807]: I1014 13:23:57.062266 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:57.062409 master-0 kubenswrapper[4807]: I1014 13:23:57.062387 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:57.062409 master-0 kubenswrapper[4807]: I1014 13:23:57.062402 4807 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:57.062409 master-0 kubenswrapper[4807]: I1014 13:23:57.062415 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Oct 14 13:23:57.403132 master-0 kubenswrapper[4807]: I1014 13:23:57.403039 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:23:57.404070 master-0 kubenswrapper[4807]: E1014 13:23:57.403440 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"etcd\" with CrashLoopBackOff: \"back-off 10s restarting failed container=etcd pod=etcd-master-0_openshift-etcd(a7e53a8977ce5fc5588aef94f91dcc24)\"" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" Oct 14 13:23:58.478369 master-0 kubenswrapper[4807]: I1014 13:23:58.478294 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-guard-master-0"] Oct 14 13:23:58.479047 master-0 kubenswrapper[4807]: I1014 13:23:58.478928 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:23:58.484432 master-0 kubenswrapper[4807]: I1014 13:23:58.484376 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"default-dockercfg-xsnqg" Oct 14 13:23:58.484902 master-0 kubenswrapper[4807]: I1014 13:23:58.484856 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"kube-root-ca.crt" Oct 14 13:23:58.485311 master-0 kubenswrapper[4807]: I1014 13:23:58.485246 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-etcd"/"openshift-service-ca.crt" Oct 14 13:23:58.651038 master-0 kubenswrapper[4807]: I1014 13:23:58.650934 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/etcd-guard-master-0"] Oct 14 13:23:58.681324 master-0 kubenswrapper[4807]: I1014 13:23:58.681243 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgl4d\" (UniqueName: \"kubernetes.io/projected/1dce93eb-a125-476a-8f6b-c704747457f6-kube-api-access-dgl4d\") pod \"etcd-guard-master-0\" (UID: \"1dce93eb-a125-476a-8f6b-c704747457f6\") " pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:23:58.782085 master-0 kubenswrapper[4807]: I1014 13:23:58.781873 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dgl4d\" (UniqueName: \"kubernetes.io/projected/1dce93eb-a125-476a-8f6b-c704747457f6-kube-api-access-dgl4d\") pod \"etcd-guard-master-0\" (UID: \"1dce93eb-a125-476a-8f6b-c704747457f6\") " pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:23:58.806996 master-0 kubenswrapper[4807]: I1014 13:23:58.806881 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgl4d\" (UniqueName: \"kubernetes.io/projected/1dce93eb-a125-476a-8f6b-c704747457f6-kube-api-access-dgl4d\") pod \"etcd-guard-master-0\" (UID: \"1dce93eb-a125-476a-8f6b-c704747457f6\") " pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:23:59.099083 master-0 kubenswrapper[4807]: I1014 13:23:59.098894 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:23:59.517878 master-0 kubenswrapper[4807]: I1014 13:23:59.517816 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/etcd-guard-master-0"] Oct 14 13:24:00.417825 master-0 kubenswrapper[4807]: I1014 13:24:00.417603 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-guard-master-0" event={"ID":"1dce93eb-a125-476a-8f6b-c704747457f6","Type":"ContainerStarted","Data":"411acd556f58c2c41753994422821418d627f1a3ebe75105723ea9b015d01ce2"} Oct 14 13:24:00.417825 master-0 kubenswrapper[4807]: I1014 13:24:00.417662 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-guard-master-0" event={"ID":"1dce93eb-a125-476a-8f6b-c704747457f6","Type":"ContainerStarted","Data":"4c97b78535c8b7285811286d7a2649aacfbeb4a7015ca2d79f5ef4828b1d3bc0"} Oct 14 13:24:00.418189 master-0 kubenswrapper[4807]: I1014 13:24:00.417982 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:24:00.443859 master-0 kubenswrapper[4807]: I1014 13:24:00.443684 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-guard-master-0" podStartSLOduration=2.443654818 podStartE2EDuration="2.443654818s" podCreationTimestamp="2025-10-14 13:23:58 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:24:00.442277643 +0000 UTC m=+235.123579487" watchObservedRunningTime="2025-10-14 13:24:00.443654818 +0000 UTC m=+235.124956682" Oct 14 13:24:04.001955 master-0 kubenswrapper[4807]: E1014 13:24:04.001840 4807 file.go:109] "Unable to process watch event" err="can't process config file \"/etc/kubernetes/manifests/kube-apiserver-pod.yaml\": /etc/kubernetes/manifests/kube-apiserver-pod.yaml: couldn't parse as pod(Object 'Kind' is missing in 'null'), please check config file" Oct 14 13:24:04.087105 master-0 kubenswrapper[4807]: I1014 13:24:04.087021 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:24:04.088573 master-0 kubenswrapper[4807]: I1014 13:24:04.088521 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.134713 master-0 kubenswrapper[4807]: I1014 13:24:04.134650 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:24:04.145112 master-0 kubenswrapper[4807]: I1014 13:24:04.145069 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.145283 master-0 kubenswrapper[4807]: I1014 13:24:04.145126 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.145283 master-0 kubenswrapper[4807]: I1014 13:24:04.145168 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.246182 master-0 kubenswrapper[4807]: I1014 13:24:04.246135 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.246614 master-0 kubenswrapper[4807]: I1014 13:24:04.246585 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.246781 master-0 kubenswrapper[4807]: I1014 13:24:04.246233 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.246926 master-0 kubenswrapper[4807]: I1014 13:24:04.246880 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.247037 master-0 kubenswrapper[4807]: I1014 13:24:04.246697 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.247167 master-0 kubenswrapper[4807]: I1014 13:24:04.247086 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.305323 master-0 kubenswrapper[4807]: I1014 13:24:04.305164 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-scheduler/openshift-kube-scheduler-master-0" Oct 14 13:24:04.433806 master-0 kubenswrapper[4807]: I1014 13:24:04.433745 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:04.438452 master-0 kubenswrapper[4807]: I1014 13:24:04.438399 4807 generic.go:334] "Generic (PLEG): container finished" podID="b24c3020-ee66-4cae-8319-d098cc328b20" containerID="88e3a72f2158819ba3fdd0b4d3f05f6aeed1dd5bc7d773a52fa2189437592f4b" exitCode=0 Oct 14 13:24:04.438452 master-0 kubenswrapper[4807]: I1014 13:24:04.438451 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"b24c3020-ee66-4cae-8319-d098cc328b20","Type":"ContainerDied","Data":"88e3a72f2158819ba3fdd0b4d3f05f6aeed1dd5bc7d773a52fa2189437592f4b"} Oct 14 13:24:04.459794 master-0 kubenswrapper[4807]: W1014 13:24:04.459714 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40c30bb582d8e7e3bec33943f1330ffc.slice/crio-bab710abd6f809b5161a79665d568d0d1c0f14c513d8f422f2193503258efea4 WatchSource:0}: Error finding container bab710abd6f809b5161a79665d568d0d1c0f14c513d8f422f2193503258efea4: Status 404 returned error can't find the container with id bab710abd6f809b5161a79665d568d0d1c0f14c513d8f422f2193503258efea4 Oct 14 13:24:04.734098 master-0 kubenswrapper[4807]: I1014 13:24:04.734042 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:24:04.734098 master-0 kubenswrapper[4807]: I1014 13:24:04.734096 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:24:04.743914 master-0 kubenswrapper[4807]: I1014 13:24:04.743836 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:24:05.418704 master-0 kubenswrapper[4807]: I1014 13:24:05.418586 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:24:05.419921 master-0 kubenswrapper[4807]: I1014 13:24:05.418699 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:24:05.447091 master-0 kubenswrapper[4807]: I1014 13:24:05.446996 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="57b5a24338447921547b613cda6aded66e5aa0ab5987b7f31574b05721913c72" exitCode=0 Oct 14 13:24:05.447236 master-0 kubenswrapper[4807]: I1014 13:24:05.447097 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerDied","Data":"57b5a24338447921547b613cda6aded66e5aa0ab5987b7f31574b05721913c72"} Oct 14 13:24:05.447236 master-0 kubenswrapper[4807]: I1014 13:24:05.447184 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"bab710abd6f809b5161a79665d568d0d1c0f14c513d8f422f2193503258efea4"} Oct 14 13:24:05.453724 master-0 kubenswrapper[4807]: I1014 13:24:05.453650 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:24:05.777804 master-0 kubenswrapper[4807]: I1014 13:24:05.777742 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:24:05.969544 master-0 kubenswrapper[4807]: I1014 13:24:05.969327 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access\") pod \"b24c3020-ee66-4cae-8319-d098cc328b20\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " Oct 14 13:24:05.969758 master-0 kubenswrapper[4807]: I1014 13:24:05.969599 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir\") pod \"b24c3020-ee66-4cae-8319-d098cc328b20\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " Oct 14 13:24:05.969758 master-0 kubenswrapper[4807]: I1014 13:24:05.969641 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock\") pod \"b24c3020-ee66-4cae-8319-d098cc328b20\" (UID: \"b24c3020-ee66-4cae-8319-d098cc328b20\") " Oct 14 13:24:05.969758 master-0 kubenswrapper[4807]: I1014 13:24:05.969711 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "b24c3020-ee66-4cae-8319-d098cc328b20" (UID: "b24c3020-ee66-4cae-8319-d098cc328b20"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:24:05.969934 master-0 kubenswrapper[4807]: I1014 13:24:05.969857 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock" (OuterVolumeSpecName: "var-lock") pod "b24c3020-ee66-4cae-8319-d098cc328b20" (UID: "b24c3020-ee66-4cae-8319-d098cc328b20"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:24:05.969934 master-0 kubenswrapper[4807]: I1014 13:24:05.969917 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:24:05.972737 master-0 kubenswrapper[4807]: I1014 13:24:05.972653 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "b24c3020-ee66-4cae-8319-d098cc328b20" (UID: "b24c3020-ee66-4cae-8319-d098cc328b20"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:24:06.071483 master-0 kubenswrapper[4807]: I1014 13:24:06.071325 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/b24c3020-ee66-4cae-8319-d098cc328b20-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:24:06.071483 master-0 kubenswrapper[4807]: I1014 13:24:06.071375 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/b24c3020-ee66-4cae-8319-d098cc328b20-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:24:06.470797 master-0 kubenswrapper[4807]: I1014 13:24:06.469891 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"c3cf45ef34f25e08c26b027a0766915776abd26c9522b9ac0f232df64f0e6c43"} Oct 14 13:24:06.470797 master-0 kubenswrapper[4807]: I1014 13:24:06.469960 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"0e684b866a40c803a4fd7b32d2dd43092436b26316f3af5795b50321d753ebef"} Oct 14 13:24:06.470797 master-0 kubenswrapper[4807]: I1014 13:24:06.469996 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"dec5918ebbe7cb191e8c2bdaa2d0bd65a9239fcf84d289def1bc5626181876f2"} Oct 14 13:24:06.473058 master-0 kubenswrapper[4807]: I1014 13:24:06.472028 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-5-master-0" event={"ID":"b24c3020-ee66-4cae-8319-d098cc328b20","Type":"ContainerDied","Data":"4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a"} Oct 14 13:24:06.473058 master-0 kubenswrapper[4807]: I1014 13:24:06.472061 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-5-master-0" Oct 14 13:24:06.473058 master-0 kubenswrapper[4807]: I1014 13:24:06.472070 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4531cce47d96574c5445ead63c7d152ac4e2fb7a71a4e8b405c795c45c136f3a" Oct 14 13:24:07.096089 master-0 kubenswrapper[4807]: I1014 13:24:07.096038 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/etcd-guard-master-0"] Oct 14 13:24:07.096342 master-0 kubenswrapper[4807]: I1014 13:24:07.096163 4807 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Oct 14 13:24:07.480402 master-0 kubenswrapper[4807]: I1014 13:24:07.480347 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"3ab81a7a646d8f6d5bcae00d5538afa1e6a01ee30e055c4fe670b2c146c7720b"} Oct 14 13:24:07.480402 master-0 kubenswrapper[4807]: I1014 13:24:07.480394 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"40c30bb582d8e7e3bec33943f1330ffc","Type":"ContainerStarted","Data":"5c5daacfb0225fe961091c33b1dc83dfd171d82a17eb297f5b8ce555bc2aa238"} Oct 14 13:24:07.480925 master-0 kubenswrapper[4807]: I1014 13:24:07.480566 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:07.515632 master-0 kubenswrapper[4807]: I1014 13:24:07.515551 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=3.515533865 podStartE2EDuration="3.515533865s" podCreationTimestamp="2025-10-14 13:24:04 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:24:07.513276587 +0000 UTC m=+242.194578431" watchObservedRunningTime="2025-10-14 13:24:07.515533865 +0000 UTC m=+242.196835689" Oct 14 13:24:09.263436 master-0 kubenswrapper[4807]: I1014 13:24:09.263327 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:24:09.434773 master-0 kubenswrapper[4807]: I1014 13:24:09.434711 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:09.434773 master-0 kubenswrapper[4807]: I1014 13:24:09.434766 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:09.442639 master-0 kubenswrapper[4807]: I1014 13:24:09.442597 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:09.499144 master-0 kubenswrapper[4807]: I1014 13:24:09.499060 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:10.419814 master-0 kubenswrapper[4807]: I1014 13:24:10.419664 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:24:10.419814 master-0 kubenswrapper[4807]: I1014 13:24:10.419772 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:24:10.499806 master-0 kubenswrapper[4807]: I1014 13:24:10.499714 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:24:10.503069 master-0 kubenswrapper[4807]: I1014 13:24:10.502997 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"a7e53a8977ce5fc5588aef94f91dcc24","Type":"ContainerStarted","Data":"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c"} Oct 14 13:24:10.555702 master-0 kubenswrapper[4807]: I1014 13:24:10.555605 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=24.555583276 podStartE2EDuration="24.555583276s" podCreationTimestamp="2025-10-14 13:23:46 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:24:10.553584785 +0000 UTC m=+245.234886709" watchObservedRunningTime="2025-10-14 13:24:10.555583276 +0000 UTC m=+245.236885100" Oct 14 13:24:11.352517 master-0 kubenswrapper[4807]: I1014 13:24:11.352109 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-guard-master-0"] Oct 14 13:24:11.352517 master-0 kubenswrapper[4807]: E1014 13:24:11.352362 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b24c3020-ee66-4cae-8319-d098cc328b20" containerName="installer" Oct 14 13:24:11.352517 master-0 kubenswrapper[4807]: I1014 13:24:11.352382 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="b24c3020-ee66-4cae-8319-d098cc328b20" containerName="installer" Oct 14 13:24:11.352917 master-0 kubenswrapper[4807]: I1014 13:24:11.352550 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="b24c3020-ee66-4cae-8319-d098cc328b20" containerName="installer" Oct 14 13:24:11.353298 master-0 kubenswrapper[4807]: I1014 13:24:11.353124 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:11.356805 master-0 kubenswrapper[4807]: I1014 13:24:11.356736 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"openshift-service-ca.crt" Oct 14 13:24:11.357074 master-0 kubenswrapper[4807]: I1014 13:24:11.357029 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-kube-apiserver"/"kube-root-ca.crt" Oct 14 13:24:11.357281 master-0 kubenswrapper[4807]: I1014 13:24:11.357249 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"default-dockercfg-pd7qg" Oct 14 13:24:11.372241 master-0 kubenswrapper[4807]: I1014 13:24:11.372116 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-guard-master-0"] Oct 14 13:24:11.453596 master-0 kubenswrapper[4807]: I1014 13:24:11.453536 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:24:11.544237 master-0 kubenswrapper[4807]: I1014 13:24:11.544190 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv4m2\" (UniqueName: \"kubernetes.io/projected/78f899c2-405c-4eec-8b9c-ecb92f8bb70b-kube-api-access-qv4m2\") pod \"kube-apiserver-guard-master-0\" (UID: \"78f899c2-405c-4eec-8b9c-ecb92f8bb70b\") " pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:11.645227 master-0 kubenswrapper[4807]: I1014 13:24:11.645030 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-qv4m2\" (UniqueName: \"kubernetes.io/projected/78f899c2-405c-4eec-8b9c-ecb92f8bb70b-kube-api-access-qv4m2\") pod \"kube-apiserver-guard-master-0\" (UID: \"78f899c2-405c-4eec-8b9c-ecb92f8bb70b\") " pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:11.665526 master-0 kubenswrapper[4807]: I1014 13:24:11.665412 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv4m2\" (UniqueName: \"kubernetes.io/projected/78f899c2-405c-4eec-8b9c-ecb92f8bb70b-kube-api-access-qv4m2\") pod \"kube-apiserver-guard-master-0\" (UID: \"78f899c2-405c-4eec-8b9c-ecb92f8bb70b\") " pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:11.698025 master-0 kubenswrapper[4807]: I1014 13:24:11.697925 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:12.063396 master-0 kubenswrapper[4807]: I1014 13:24:12.063200 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Oct 14 13:24:12.132654 master-0 kubenswrapper[4807]: I1014 13:24:12.132562 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-guard-master-0"] Oct 14 13:24:12.140814 master-0 kubenswrapper[4807]: W1014 13:24:12.139375 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f899c2_405c_4eec_8b9c_ecb92f8bb70b.slice/crio-f6b4107f2da17d8563693293960283c2183067c608f68b89c54e2708d70d54cc WatchSource:0}: Error finding container f6b4107f2da17d8563693293960283c2183067c608f68b89c54e2708d70d54cc: Status 404 returned error can't find the container with id f6b4107f2da17d8563693293960283c2183067c608f68b89c54e2708d70d54cc Oct 14 13:24:12.515815 master-0 kubenswrapper[4807]: I1014 13:24:12.515687 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" event={"ID":"78f899c2-405c-4eec-8b9c-ecb92f8bb70b","Type":"ContainerStarted","Data":"65bbc494581fea738f0d26068e1bf7360a7002a7571248c406bf114fac0ccfbb"} Oct 14 13:24:12.515815 master-0 kubenswrapper[4807]: I1014 13:24:12.515772 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" event={"ID":"78f899c2-405c-4eec-8b9c-ecb92f8bb70b","Type":"ContainerStarted","Data":"f6b4107f2da17d8563693293960283c2183067c608f68b89c54e2708d70d54cc"} Oct 14 13:24:12.516592 master-0 kubenswrapper[4807]: I1014 13:24:12.515984 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:12.522830 master-0 kubenswrapper[4807]: I1014 13:24:12.522778 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:24:12.543639 master-0 kubenswrapper[4807]: I1014 13:24:12.543531 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podStartSLOduration=1.5435097359999999 podStartE2EDuration="1.543509736s" podCreationTimestamp="2025-10-14 13:24:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:24:12.543224679 +0000 UTC m=+247.224526503" watchObservedRunningTime="2025-10-14 13:24:12.543509736 +0000 UTC m=+247.224811560" Oct 14 13:24:17.062720 master-0 kubenswrapper[4807]: I1014 13:24:17.062612 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Oct 14 13:24:20.553949 master-0 kubenswrapper[4807]: I1014 13:24:20.553852 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-guard-master-0"] Oct 14 13:24:24.442130 master-0 kubenswrapper[4807]: I1014 13:24:24.442030 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:24:27.086637 master-0 kubenswrapper[4807]: I1014 13:24:27.086531 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Oct 14 13:24:27.101010 master-0 kubenswrapper[4807]: I1014 13:24:27.100941 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Oct 14 13:24:31.313447 master-0 kubenswrapper[4807]: I1014 13:24:31.313288 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:24:31.350756 master-0 kubenswrapper[4807]: I1014 13:24:31.350683 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:24:31.669309 master-0 kubenswrapper[4807]: I1014 13:24:31.669199 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-1" Oct 14 13:24:44.376434 master-0 kubenswrapper[4807]: I1014 13:24:44.376377 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:24:57.888704 master-0 kubenswrapper[4807]: I1014 13:24:57.885941 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:24:57.888704 master-0 kubenswrapper[4807]: I1014 13:24:57.886310 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" containerID="cri-o://1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509" gracePeriod=120 Oct 14 13:24:57.888704 master-0 kubenswrapper[4807]: I1014 13:24:57.886866 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver-check-endpoints" containerID="cri-o://a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199" gracePeriod=120 Oct 14 13:24:58.791897 master-0 kubenswrapper[4807]: I1014 13:24:58.791813 4807 generic.go:334] "Generic (PLEG): container finished" podID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerID="a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199" exitCode=0 Oct 14 13:24:58.791897 master-0 kubenswrapper[4807]: I1014 13:24:58.791886 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerDied","Data":"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199"} Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: I1014 13:25:02.165092 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:02.165181 master-0 kubenswrapper[4807]: I1014 13:25:02.165182 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:06.161545 master-0 kubenswrapper[4807]: I1014 13:25:06.161449 4807 kubelet.go:1505] "Image garbage collection succeeded" Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: I1014 13:25:07.167788 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:07.167950 master-0 kubenswrapper[4807]: I1014 13:25:07.167877 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:09.421224 master-0 kubenswrapper[4807]: I1014 13:25:09.421033 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-77d8f866f9-8jlq8" podUID="30903b96-1916-42f4-a30f-5d962ea7c386" containerName="console" containerID="cri-o://b8fdd5da1e3d5f8df8bec78d70dc8c884fb3218a640447a571e6f65d706ee529" gracePeriod=15 Oct 14 13:25:09.857423 master-0 kubenswrapper[4807]: I1014 13:25:09.857364 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77d8f866f9-8jlq8_30903b96-1916-42f4-a30f-5d962ea7c386/console/0.log" Oct 14 13:25:09.857792 master-0 kubenswrapper[4807]: I1014 13:25:09.857445 4807 generic.go:334] "Generic (PLEG): container finished" podID="30903b96-1916-42f4-a30f-5d962ea7c386" containerID="b8fdd5da1e3d5f8df8bec78d70dc8c884fb3218a640447a571e6f65d706ee529" exitCode=2 Oct 14 13:25:09.857792 master-0 kubenswrapper[4807]: I1014 13:25:09.857552 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d8f866f9-8jlq8" event={"ID":"30903b96-1916-42f4-a30f-5d962ea7c386","Type":"ContainerDied","Data":"b8fdd5da1e3d5f8df8bec78d70dc8c884fb3218a640447a571e6f65d706ee529"} Oct 14 13:25:09.911641 master-0 kubenswrapper[4807]: I1014 13:25:09.911556 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77d8f866f9-8jlq8_30903b96-1916-42f4-a30f-5d962ea7c386/console/0.log" Oct 14 13:25:09.911908 master-0 kubenswrapper[4807]: I1014 13:25:09.911688 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:25:10.014120 master-0 kubenswrapper[4807]: I1014 13:25:10.014008 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.014120 master-0 kubenswrapper[4807]: I1014 13:25:10.014120 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v5p62\" (UniqueName: \"kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014210 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014251 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014315 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014383 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014444 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert\") pod \"30903b96-1916-42f4-a30f-5d962ea7c386\" (UID: \"30903b96-1916-42f4-a30f-5d962ea7c386\") " Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.014796 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config" (OuterVolumeSpecName: "console-config") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.015311 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca" (OuterVolumeSpecName: "service-ca") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.015581 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:25:10.015781 master-0 kubenswrapper[4807]: I1014 13:25:10.015735 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:25:10.016248 master-0 kubenswrapper[4807]: I1014 13:25:10.015810 4807 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-console-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.016248 master-0 kubenswrapper[4807]: I1014 13:25:10.015843 4807 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-service-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.016248 master-0 kubenswrapper[4807]: I1014 13:25:10.015864 4807 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.018696 master-0 kubenswrapper[4807]: I1014 13:25:10.018545 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:25:10.018885 master-0 kubenswrapper[4807]: I1014 13:25:10.018825 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62" (OuterVolumeSpecName: "kube-api-access-v5p62") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "kube-api-access-v5p62". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:25:10.023880 master-0 kubenswrapper[4807]: I1014 13:25:10.023779 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30903b96-1916-42f4-a30f-5d962ea7c386" (UID: "30903b96-1916-42f4-a30f-5d962ea7c386"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:25:10.117091 master-0 kubenswrapper[4807]: I1014 13:25:10.116833 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v5p62\" (UniqueName: \"kubernetes.io/projected/30903b96-1916-42f4-a30f-5d962ea7c386-kube-api-access-v5p62\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.117091 master-0 kubenswrapper[4807]: I1014 13:25:10.116894 4807 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.117091 master-0 kubenswrapper[4807]: I1014 13:25:10.116911 4807 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30903b96-1916-42f4-a30f-5d962ea7c386-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.117091 master-0 kubenswrapper[4807]: I1014 13:25:10.116923 4807 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30903b96-1916-42f4-a30f-5d962ea7c386-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:25:10.866291 master-0 kubenswrapper[4807]: I1014 13:25:10.866199 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77d8f866f9-8jlq8_30903b96-1916-42f4-a30f-5d962ea7c386/console/0.log" Oct 14 13:25:10.867115 master-0 kubenswrapper[4807]: I1014 13:25:10.866379 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77d8f866f9-8jlq8" event={"ID":"30903b96-1916-42f4-a30f-5d962ea7c386","Type":"ContainerDied","Data":"2f3ca8355e71f452eeaa30571b5bd12384f60fd4c023f9e5670103a589a96b99"} Oct 14 13:25:10.867115 master-0 kubenswrapper[4807]: I1014 13:25:10.866499 4807 scope.go:117] "RemoveContainer" containerID="b8fdd5da1e3d5f8df8bec78d70dc8c884fb3218a640447a571e6f65d706ee529" Oct 14 13:25:10.867115 master-0 kubenswrapper[4807]: I1014 13:25:10.866511 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77d8f866f9-8jlq8" Oct 14 13:25:10.897367 master-0 kubenswrapper[4807]: I1014 13:25:10.897309 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:25:10.934710 master-0 kubenswrapper[4807]: I1014 13:25:10.934649 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77d8f866f9-8jlq8"] Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: I1014 13:25:12.168255 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:12.168344 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:12.170127 master-0 kubenswrapper[4807]: I1014 13:25:12.168363 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:12.170127 master-0 kubenswrapper[4807]: I1014 13:25:12.168582 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:25:12.272054 master-0 kubenswrapper[4807]: I1014 13:25:12.271967 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30903b96-1916-42f4-a30f-5d962ea7c386" path="/var/lib/kubelet/pods/30903b96-1916-42f4-a30f-5d962ea7c386/volumes" Oct 14 13:25:14.451415 master-0 kubenswrapper[4807]: I1014 13:25:14.451309 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:25:14.452555 master-0 kubenswrapper[4807]: E1014 13:25:14.451584 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="30903b96-1916-42f4-a30f-5d962ea7c386" containerName="console" Oct 14 13:25:14.452555 master-0 kubenswrapper[4807]: I1014 13:25:14.451607 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="30903b96-1916-42f4-a30f-5d962ea7c386" containerName="console" Oct 14 13:25:14.452555 master-0 kubenswrapper[4807]: I1014 13:25:14.451720 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="30903b96-1916-42f4-a30f-5d962ea7c386" containerName="console" Oct 14 13:25:14.452555 master-0 kubenswrapper[4807]: I1014 13:25:14.452337 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.456147 master-0 kubenswrapper[4807]: I1014 13:25:14.456086 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"kube-root-ca.crt" Oct 14 13:25:14.456147 master-0 kubenswrapper[4807]: I1014 13:25:14.456141 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Oct 14 13:25:14.456367 master-0 kubenswrapper[4807]: I1014 13:25:14.456237 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Oct 14 13:25:14.456437 master-0 kubenswrapper[4807]: I1014 13:25:14.456348 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"service-ca" Oct 14 13:25:14.456437 master-0 kubenswrapper[4807]: I1014 13:25:14.456354 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-r2r7j" Oct 14 13:25:14.456615 master-0 kubenswrapper[4807]: I1014 13:25:14.456446 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"openshift-service-ca.crt" Oct 14 13:25:14.456615 master-0 kubenswrapper[4807]: I1014 13:25:14.456528 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"oauth-serving-cert" Oct 14 13:25:14.456985 master-0 kubenswrapper[4807]: I1014 13:25:14.456903 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"console-config" Oct 14 13:25:14.470627 master-0 kubenswrapper[4807]: I1014 13:25:14.470566 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-console"/"trusted-ca-bundle" Oct 14 13:25:14.474504 master-0 kubenswrapper[4807]: I1014 13:25:14.474411 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:25:14.581650 master-0 kubenswrapper[4807]: I1014 13:25:14.581537 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.581650 master-0 kubenswrapper[4807]: I1014 13:25:14.581637 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.581650 master-0 kubenswrapper[4807]: I1014 13:25:14.581660 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.581650 master-0 kubenswrapper[4807]: I1014 13:25:14.581680 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xcrwh\" (UniqueName: \"kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.582191 master-0 kubenswrapper[4807]: I1014 13:25:14.581700 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.582191 master-0 kubenswrapper[4807]: I1014 13:25:14.581829 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.582191 master-0 kubenswrapper[4807]: I1014 13:25:14.582010 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.683855 master-0 kubenswrapper[4807]: I1014 13:25:14.683757 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.683887 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.683926 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.683958 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.683993 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xcrwh\" (UniqueName: \"kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.684026 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.684254 master-0 kubenswrapper[4807]: I1014 13:25:14.684072 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.686030 master-0 kubenswrapper[4807]: I1014 13:25:14.685956 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.686121 master-0 kubenswrapper[4807]: I1014 13:25:14.686026 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.686121 master-0 kubenswrapper[4807]: I1014 13:25:14.686035 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.687305 master-0 kubenswrapper[4807]: I1014 13:25:14.687231 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.689835 master-0 kubenswrapper[4807]: I1014 13:25:14.689777 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.690757 master-0 kubenswrapper[4807]: I1014 13:25:14.690670 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.718789 master-0 kubenswrapper[4807]: I1014 13:25:14.718617 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xcrwh\" (UniqueName: \"kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh\") pod \"console-564c479f-s9vtn\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:14.769263 master-0 kubenswrapper[4807]: I1014 13:25:14.769123 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:15.253930 master-0 kubenswrapper[4807]: I1014 13:25:15.253822 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:25:15.431635 master-0 kubenswrapper[4807]: W1014 13:25:15.431576 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ddf83a_8e91_4df8_b675_643f7150136a.slice/crio-df1d5b1a507da42b248a897c635ab3992ce3818e3dcaba7f72853c7f6d952226 WatchSource:0}: Error finding container df1d5b1a507da42b248a897c635ab3992ce3818e3dcaba7f72853c7f6d952226: Status 404 returned error can't find the container with id df1d5b1a507da42b248a897c635ab3992ce3818e3dcaba7f72853c7f6d952226 Oct 14 13:25:15.901255 master-0 kubenswrapper[4807]: I1014 13:25:15.901132 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c479f-s9vtn" event={"ID":"18ddf83a-8e91-4df8-b675-643f7150136a","Type":"ContainerStarted","Data":"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0"} Oct 14 13:25:15.901255 master-0 kubenswrapper[4807]: I1014 13:25:15.901201 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c479f-s9vtn" event={"ID":"18ddf83a-8e91-4df8-b675-643f7150136a","Type":"ContainerStarted","Data":"df1d5b1a507da42b248a897c635ab3992ce3818e3dcaba7f72853c7f6d952226"} Oct 14 13:25:15.929191 master-0 kubenswrapper[4807]: I1014 13:25:15.929103 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-564c479f-s9vtn" podStartSLOduration=31.929075893 podStartE2EDuration="31.929075893s" podCreationTimestamp="2025-10-14 13:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:25:15.927910771 +0000 UTC m=+310.609212605" watchObservedRunningTime="2025-10-14 13:25:15.929075893 +0000 UTC m=+310.610377717" Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: I1014 13:25:17.168247 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:17.168355 master-0 kubenswrapper[4807]: I1014 13:25:17.168342 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: I1014 13:25:22.169419 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:22.169572 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:22.170544 master-0 kubenswrapper[4807]: I1014 13:25:22.169654 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:24.770067 master-0 kubenswrapper[4807]: I1014 13:25:24.769968 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:24.770067 master-0 kubenswrapper[4807]: I1014 13:25:24.770062 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:24.775960 master-0 kubenswrapper[4807]: I1014 13:25:24.775891 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:24.957674 master-0 kubenswrapper[4807]: I1014 13:25:24.957149 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: I1014 13:25:27.168531 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:27.168590 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:27.170363 master-0 kubenswrapper[4807]: I1014 13:25:27.168614 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: I1014 13:25:32.167120 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:32.167355 master-0 kubenswrapper[4807]: I1014 13:25:32.167246 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: I1014 13:25:37.168938 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:37.169061 master-0 kubenswrapper[4807]: I1014 13:25:37.169047 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:41.903876 master-0 kubenswrapper[4807]: I1014 13:25:41.903785 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:25:41.905326 master-0 kubenswrapper[4807]: I1014 13:25:41.905234 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" containerID="cri-o://50fe65e67b31aca90bbce3f2d0d071e1fd07429f3f7d008f6e06c12d8e6fb702" gracePeriod=120 Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: I1014 13:25:42.168509 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:42.168715 master-0 kubenswrapper[4807]: I1014 13:25:42.168638 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: I1014 13:25:42.478625 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:42.478842 master-0 kubenswrapper[4807]: I1014 13:25:42.478726 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: I1014 13:25:47.167060 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/image.openshift.io-apiserver-caches ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-bootstrapclusterroles ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/authorization.openshift.io-ensurenodebootstrap-sa ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectcache ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/project.openshift.io-projectauthorizationcache ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startinformers ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-restmapperupdater ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:47.167126 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:47.169735 master-0 kubenswrapper[4807]: I1014 13:25:47.169644 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: I1014 13:25:47.479884 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:47.480051 master-0 kubenswrapper[4807]: I1014 13:25:47.480008 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:52.161794 master-0 kubenswrapper[4807]: I1014 13:25:52.161685 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:25:52.162694 master-0 kubenswrapper[4807]: I1014 13:25:52.161807 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: I1014 13:25:52.480108 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:52.480331 master-0 kubenswrapper[4807]: I1014 13:25:52.480226 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:25:52.481293 master-0 kubenswrapper[4807]: I1014 13:25:52.480374 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:25:57.161985 master-0 kubenswrapper[4807]: I1014 13:25:57.161862 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:25:57.161985 master-0 kubenswrapper[4807]: I1014 13:25:57.161985 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: I1014 13:25:57.478791 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:25:57.478972 master-0 kubenswrapper[4807]: I1014 13:25:57.478896 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:02.161964 master-0 kubenswrapper[4807]: I1014 13:26:02.161856 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:02.162875 master-0 kubenswrapper[4807]: I1014 13:26:02.162001 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: I1014 13:26:02.482349 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:02.482554 master-0 kubenswrapper[4807]: I1014 13:26:02.482452 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:07.161241 master-0 kubenswrapper[4807]: I1014 13:26:07.161131 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:07.161241 master-0 kubenswrapper[4807]: I1014 13:26:07.161232 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: I1014 13:26:07.479143 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:07.479358 master-0 kubenswrapper[4807]: I1014 13:26:07.479254 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:12.161652 master-0 kubenswrapper[4807]: I1014 13:26:12.161576 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:12.161652 master-0 kubenswrapper[4807]: I1014 13:26:12.161662 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: I1014 13:26:12.481439 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:12.481683 master-0 kubenswrapper[4807]: I1014 13:26:12.481549 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:17.161623 master-0 kubenswrapper[4807]: I1014 13:26:17.161453 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:17.162548 master-0 kubenswrapper[4807]: I1014 13:26:17.161624 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: I1014 13:26:17.479552 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:17.479731 master-0 kubenswrapper[4807]: I1014 13:26:17.479657 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:22.161293 master-0 kubenswrapper[4807]: I1014 13:26:22.161175 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:22.162208 master-0 kubenswrapper[4807]: I1014 13:26:22.161291 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: I1014 13:26:22.479884 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:22.480061 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:22.481213 master-0 kubenswrapper[4807]: I1014 13:26:22.480074 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:27.162948 master-0 kubenswrapper[4807]: I1014 13:26:27.162846 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:27.163611 master-0 kubenswrapper[4807]: I1014 13:26:27.162961 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: I1014 13:26:27.480128 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]etcd excluded: ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]etcd-readiness excluded: ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/max-in-flight-filter ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartUserInformer ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartOAuthInformer ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-StartTokenTimeoutUpdater ok Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:26:27.480302 master-0 kubenswrapper[4807]: I1014 13:26:27.480247 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:26:32.161588 master-0 kubenswrapper[4807]: I1014 13:26:32.161505 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:32.161588 master-0 kubenswrapper[4807]: I1014 13:26:32.161583 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:32.473395 master-0 kubenswrapper[4807]: I1014 13:26:32.473164 4807 patch_prober.go:28] interesting pod/apiserver-84c8b8d745-wnpsp container/oauth-apiserver namespace/openshift-oauth-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.17:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.17:8443: connect: connection refused" start-of-body= Oct 14 13:26:32.473395 master-0 kubenswrapper[4807]: I1014 13:26:32.473319 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" probeResult="failure" output="Get \"https://10.130.0.17:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.17:8443: connect: connection refused" Oct 14 13:26:34.431634 master-0 kubenswrapper[4807]: I1014 13:26:34.431540 4807 generic.go:334] "Generic (PLEG): container finished" podID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerID="50fe65e67b31aca90bbce3f2d0d071e1fd07429f3f7d008f6e06c12d8e6fb702" exitCode=0 Oct 14 13:26:34.431634 master-0 kubenswrapper[4807]: I1014 13:26:34.431614 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" event={"ID":"a65d0030-ef03-4506-9d47-06c1eeda7831","Type":"ContainerDied","Data":"50fe65e67b31aca90bbce3f2d0d071e1fd07429f3f7d008f6e06c12d8e6fb702"} Oct 14 13:26:34.875246 master-0 kubenswrapper[4807]: I1014 13:26:34.875151 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:26:34.982214 master-0 kubenswrapper[4807]: I1014 13:26:34.982023 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982214 master-0 kubenswrapper[4807]: I1014 13:26:34.982166 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982214 master-0 kubenswrapper[4807]: I1014 13:26:34.982219 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982286 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-747zn\" (UniqueName: \"kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982324 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982351 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982417 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982383 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:26:34.982499 master-0 kubenswrapper[4807]: I1014 13:26:34.982446 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies\") pod \"a65d0030-ef03-4506-9d47-06c1eeda7831\" (UID: \"a65d0030-ef03-4506-9d47-06c1eeda7831\") " Oct 14 13:26:34.982732 master-0 kubenswrapper[4807]: I1014 13:26:34.982682 4807 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:34.983036 master-0 kubenswrapper[4807]: I1014 13:26:34.982970 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:34.983330 master-0 kubenswrapper[4807]: I1014 13:26:34.983281 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:34.984143 master-0 kubenswrapper[4807]: I1014 13:26:34.984026 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies" (OuterVolumeSpecName: "audit-policies") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "audit-policies". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:34.988735 master-0 kubenswrapper[4807]: I1014 13:26:34.988687 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:34.989249 master-0 kubenswrapper[4807]: I1014 13:26:34.989174 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:34.989873 master-0 kubenswrapper[4807]: I1014 13:26:34.989826 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:34.993124 master-0 kubenswrapper[4807]: I1014 13:26:34.993026 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn" (OuterVolumeSpecName: "kube-api-access-747zn") pod "a65d0030-ef03-4506-9d47-06c1eeda7831" (UID: "a65d0030-ef03-4506-9d47-06c1eeda7831"). InnerVolumeSpecName "kube-api-access-747zn". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083591 4807 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-client\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083631 4807 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-etcd-serving-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083642 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-747zn\" (UniqueName: \"kubernetes.io/projected/a65d0030-ef03-4506-9d47-06c1eeda7831-kube-api-access-747zn\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083654 4807 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-encryption-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083662 4807 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a65d0030-ef03-4506-9d47-06c1eeda7831-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083671 4807 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.083657 master-0 kubenswrapper[4807]: I1014 13:26:35.083680 4807 reconciler_common.go:293] "Volume detached for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/a65d0030-ef03-4506-9d47-06c1eeda7831-audit-policies\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:35.440974 master-0 kubenswrapper[4807]: I1014 13:26:35.440869 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" event={"ID":"a65d0030-ef03-4506-9d47-06c1eeda7831","Type":"ContainerDied","Data":"98d3b856a1082ec427202ef061f3c34dcb72fa8efd6134e3a8a35c8b1321644c"} Oct 14 13:26:35.440974 master-0 kubenswrapper[4807]: I1014 13:26:35.440962 4807 scope.go:117] "RemoveContainer" containerID="50fe65e67b31aca90bbce3f2d0d071e1fd07429f3f7d008f6e06c12d8e6fb702" Oct 14 13:26:35.440974 master-0 kubenswrapper[4807]: I1014 13:26:35.440987 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp" Oct 14 13:26:35.462638 master-0 kubenswrapper[4807]: I1014 13:26:35.462576 4807 scope.go:117] "RemoveContainer" containerID="d3c64bce8c8e1cb9f450a8985b72dab97abd94de52a3ff4602d575e8d61d085e" Oct 14 13:26:35.494147 master-0 kubenswrapper[4807]: I1014 13:26:35.490910 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:26:35.500041 master-0 kubenswrapper[4807]: I1014 13:26:35.499977 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-oauth-apiserver/apiserver-84c8b8d745-wnpsp"] Oct 14 13:26:36.269232 master-0 kubenswrapper[4807]: I1014 13:26:36.269105 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" path="/var/lib/kubelet/pods/a65d0030-ef03-4506-9d47-06c1eeda7831/volumes" Oct 14 13:26:37.161167 master-0 kubenswrapper[4807]: I1014 13:26:37.161087 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:37.162022 master-0 kubenswrapper[4807]: I1014 13:26:37.161208 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:37.492779 master-0 kubenswrapper[4807]: I1014 13:26:37.492535 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-oauth-apiserver/apiserver-7b6784d654-27mg2"] Oct 14 13:26:37.493187 master-0 kubenswrapper[4807]: E1014 13:26:37.492807 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="fix-audit-permissions" Oct 14 13:26:37.493187 master-0 kubenswrapper[4807]: I1014 13:26:37.492834 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="fix-audit-permissions" Oct 14 13:26:37.493187 master-0 kubenswrapper[4807]: E1014 13:26:37.493052 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" Oct 14 13:26:37.493187 master-0 kubenswrapper[4807]: I1014 13:26:37.493075 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" Oct 14 13:26:37.493543 master-0 kubenswrapper[4807]: I1014 13:26:37.493411 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a65d0030-ef03-4506-9d47-06c1eeda7831" containerName="oauth-apiserver" Oct 14 13:26:37.494278 master-0 kubenswrapper[4807]: I1014 13:26:37.494251 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.497819 master-0 kubenswrapper[4807]: I1014 13:26:37.497772 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"serving-cert" Oct 14 13:26:37.498206 master-0 kubenswrapper[4807]: I1014 13:26:37.498133 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"etcd-client" Oct 14 13:26:37.498277 master-0 kubenswrapper[4807]: I1014 13:26:37.498141 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"encryption-config-1" Oct 14 13:26:37.498845 master-0 kubenswrapper[4807]: I1014 13:26:37.498812 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-oauth-apiserver"/"oauth-apiserver-sa-dockercfg-8gpjk" Oct 14 13:26:37.498978 master-0 kubenswrapper[4807]: I1014 13:26:37.498952 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"etcd-serving-ca" Oct 14 13:26:37.499556 master-0 kubenswrapper[4807]: I1014 13:26:37.499530 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"trusted-ca-bundle" Oct 14 13:26:37.499800 master-0 kubenswrapper[4807]: I1014 13:26:37.499775 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"audit-1" Oct 14 13:26:37.500036 master-0 kubenswrapper[4807]: I1014 13:26:37.500010 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"kube-root-ca.crt" Oct 14 13:26:37.501646 master-0 kubenswrapper[4807]: I1014 13:26:37.501610 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-oauth-apiserver"/"openshift-service-ca.crt" Oct 14 13:26:37.512095 master-0 kubenswrapper[4807]: I1014 13:26:37.512016 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7b6784d654-27mg2"] Oct 14 13:26:37.616000 master-0 kubenswrapper[4807]: I1014 13:26:37.615910 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-policies\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616000 master-0 kubenswrapper[4807]: I1014 13:26:37.615984 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-serving-ca\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616354 master-0 kubenswrapper[4807]: I1014 13:26:37.616027 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-client\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616354 master-0 kubenswrapper[4807]: I1014 13:26:37.616296 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-dir\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616422 master-0 kubenswrapper[4807]: I1014 13:26:37.616386 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-encryption-config\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616486 master-0 kubenswrapper[4807]: I1014 13:26:37.616440 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-serving-cert\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616601 master-0 kubenswrapper[4807]: I1014 13:26:37.616567 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vszfj\" (UniqueName: \"kubernetes.io/projected/b3275d9d-1998-47e4-b6bf-73bba3222f41-kube-api-access-vszfj\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.616667 master-0 kubenswrapper[4807]: I1014 13:26:37.616642 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-trusted-ca-bundle\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.717828 master-0 kubenswrapper[4807]: I1014 13:26:37.717697 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-policies\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.717828 master-0 kubenswrapper[4807]: I1014 13:26:37.717777 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-serving-ca\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.717828 master-0 kubenswrapper[4807]: I1014 13:26:37.717845 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-client\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.717896 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-dir\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.717925 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-encryption-config\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.717948 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-serving-cert\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.717974 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vszfj\" (UniqueName: \"kubernetes.io/projected/b3275d9d-1998-47e4-b6bf-73bba3222f41-kube-api-access-vszfj\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.718000 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-trusted-ca-bundle\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718296 master-0 kubenswrapper[4807]: I1014 13:26:37.718049 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-dir\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.718957 master-0 kubenswrapper[4807]: I1014 13:26:37.718918 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-trusted-ca-bundle\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.719060 master-0 kubenswrapper[4807]: I1014 13:26:37.719002 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-policies\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-audit-policies\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.719408 master-0 kubenswrapper[4807]: I1014 13:26:37.719362 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-serving-ca\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.722555 master-0 kubenswrapper[4807]: I1014 13:26:37.722516 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-encryption-config\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.722791 master-0 kubenswrapper[4807]: I1014 13:26:37.722726 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-etcd-client\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.722931 master-0 kubenswrapper[4807]: I1014 13:26:37.722880 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b3275d9d-1998-47e4-b6bf-73bba3222f41-serving-cert\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.742260 master-0 kubenswrapper[4807]: I1014 13:26:37.742111 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vszfj\" (UniqueName: \"kubernetes.io/projected/b3275d9d-1998-47e4-b6bf-73bba3222f41-kube-api-access-vszfj\") pod \"apiserver-7b6784d654-27mg2\" (UID: \"b3275d9d-1998-47e4-b6bf-73bba3222f41\") " pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:37.851943 master-0 kubenswrapper[4807]: I1014 13:26:37.851879 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:38.302813 master-0 kubenswrapper[4807]: I1014 13:26:38.302523 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-oauth-apiserver/apiserver-7b6784d654-27mg2"] Oct 14 13:26:38.314130 master-0 kubenswrapper[4807]: W1014 13:26:38.314050 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3275d9d_1998_47e4_b6bf_73bba3222f41.slice/crio-e9bac9d467265f021ebfc4206ed97c421c87d3795b6794185c30d8ef336f8066 WatchSource:0}: Error finding container e9bac9d467265f021ebfc4206ed97c421c87d3795b6794185c30d8ef336f8066: Status 404 returned error can't find the container with id e9bac9d467265f021ebfc4206ed97c421c87d3795b6794185c30d8ef336f8066 Oct 14 13:26:38.459842 master-0 kubenswrapper[4807]: I1014 13:26:38.459731 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" event={"ID":"b3275d9d-1998-47e4-b6bf-73bba3222f41","Type":"ContainerStarted","Data":"e9bac9d467265f021ebfc4206ed97c421c87d3795b6794185c30d8ef336f8066"} Oct 14 13:26:39.470495 master-0 kubenswrapper[4807]: I1014 13:26:39.470399 4807 generic.go:334] "Generic (PLEG): container finished" podID="b3275d9d-1998-47e4-b6bf-73bba3222f41" containerID="8f3e7c26c162c77db88170d240b099a59d6419b40c57c8fa64327cdc75bff1ae" exitCode=0 Oct 14 13:26:39.470495 master-0 kubenswrapper[4807]: I1014 13:26:39.470498 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" event={"ID":"b3275d9d-1998-47e4-b6bf-73bba3222f41","Type":"ContainerDied","Data":"8f3e7c26c162c77db88170d240b099a59d6419b40c57c8fa64327cdc75bff1ae"} Oct 14 13:26:40.480965 master-0 kubenswrapper[4807]: I1014 13:26:40.480822 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" event={"ID":"b3275d9d-1998-47e4-b6bf-73bba3222f41","Type":"ContainerStarted","Data":"e78d1119e213f0d5b244c8b5244a28e0432bbb0de97faf510f22a74cb4aed496"} Oct 14 13:26:40.518034 master-0 kubenswrapper[4807]: I1014 13:26:40.517897 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" podStartSLOduration=59.517871036 podStartE2EDuration="59.517871036s" podCreationTimestamp="2025-10-14 13:25:41 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:26:40.515503 +0000 UTC m=+395.196804864" watchObservedRunningTime="2025-10-14 13:26:40.517871036 +0000 UTC m=+395.199172910" Oct 14 13:26:42.161545 master-0 kubenswrapper[4807]: I1014 13:26:42.161432 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:42.162178 master-0 kubenswrapper[4807]: I1014 13:26:42.161549 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:42.853178 master-0 kubenswrapper[4807]: I1014 13:26:42.853114 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:42.853629 master-0 kubenswrapper[4807]: I1014 13:26:42.853602 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:42.866268 master-0 kubenswrapper[4807]: I1014 13:26:42.866193 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:43.501833 master-0 kubenswrapper[4807]: I1014 13:26:43.501694 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-oauth-apiserver/apiserver-7b6784d654-27mg2" Oct 14 13:26:47.161530 master-0 kubenswrapper[4807]: I1014 13:26:47.161400 4807 patch_prober.go:28] interesting pod/apiserver-5f68d4c887-pqcgn container/openshift-apiserver namespace/openshift-apiserver: Readiness probe status=failure output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" start-of-body= Oct 14 13:26:47.162241 master-0 kubenswrapper[4807]: I1014 13:26:47.161564 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" probeResult="failure" output="Get \"https://10.130.0.16:8443/readyz?exclude=etcd&exclude=etcd-readiness\": dial tcp 10.130.0.16:8443: connect: connection refused" Oct 14 13:26:48.329775 master-0 kubenswrapper[4807]: I1014 13:26:48.329727 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:26:48.354147 master-0 kubenswrapper[4807]: I1014 13:26:48.354052 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.354381 master-0 kubenswrapper[4807]: I1014 13:26:48.354163 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.354501 master-0 kubenswrapper[4807]: I1014 13:26:48.354422 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:26:48.354606 master-0 kubenswrapper[4807]: I1014 13:26:48.354196 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.355100 master-0 kubenswrapper[4807]: I1014 13:26:48.355026 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.355332 master-0 kubenswrapper[4807]: I1014 13:26:48.355107 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.355332 master-0 kubenswrapper[4807]: I1014 13:26:48.354951 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:48.355332 master-0 kubenswrapper[4807]: I1014 13:26:48.355004 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config" (OuterVolumeSpecName: "config") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:48.355332 master-0 kubenswrapper[4807]: I1014 13:26:48.355067 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets" (OuterVolumeSpecName: "node-pullsecrets") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "node-pullsecrets". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:26:48.355332 master-0 kubenswrapper[4807]: I1014 13:26:48.355229 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.355890 master-0 kubenswrapper[4807]: I1014 13:26:48.355805 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.355890 master-0 kubenswrapper[4807]: I1014 13:26:48.355856 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pxbs5\" (UniqueName: \"kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.356775 master-0 kubenswrapper[4807]: I1014 13:26:48.355917 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.356775 master-0 kubenswrapper[4807]: I1014 13:26:48.355959 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.356775 master-0 kubenswrapper[4807]: I1014 13:26:48.355987 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca\") pod \"3002128a-ef6f-4688-ab72-9f935bd4241d\" (UID: \"3002128a-ef6f-4688-ab72-9f935bd4241d\") " Oct 14 13:26:48.356775 master-0 kubenswrapper[4807]: I1014 13:26:48.356452 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit" (OuterVolumeSpecName: "audit") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "audit". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:48.356775 master-0 kubenswrapper[4807]: I1014 13:26:48.356721 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca" (OuterVolumeSpecName: "etcd-serving-ca") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "etcd-serving-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:48.357087 master-0 kubenswrapper[4807]: I1014 13:26:48.356941 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca" (OuterVolumeSpecName: "image-import-ca") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "image-import-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:26:48.357518 master-0 kubenswrapper[4807]: I1014 13:26:48.357420 4807 reconciler_common.go:293] "Volume detached for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-audit\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357518 master-0 kubenswrapper[4807]: I1014 13:26:48.357511 4807 reconciler_common.go:293] "Volume detached for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-serving-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357747 master-0 kubenswrapper[4807]: I1014 13:26:48.357549 4807 reconciler_common.go:293] "Volume detached for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-image-import-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357747 master-0 kubenswrapper[4807]: I1014 13:26:48.357568 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357747 master-0 kubenswrapper[4807]: I1014 13:26:48.357585 4807 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3002128a-ef6f-4688-ab72-9f935bd4241d-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357747 master-0 kubenswrapper[4807]: I1014 13:26:48.357601 4807 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-audit-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.357747 master-0 kubenswrapper[4807]: I1014 13:26:48.357615 4807 reconciler_common.go:293] "Volume detached for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/3002128a-ef6f-4688-ab72-9f935bd4241d-node-pullsecrets\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.358672 master-0 kubenswrapper[4807]: I1014 13:26:48.358617 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert" (OuterVolumeSpecName: "serving-cert") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:48.359504 master-0 kubenswrapper[4807]: I1014 13:26:48.359426 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5" (OuterVolumeSpecName: "kube-api-access-pxbs5") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "kube-api-access-pxbs5". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:26:48.359904 master-0 kubenswrapper[4807]: I1014 13:26:48.359840 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config" (OuterVolumeSpecName: "encryption-config") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "encryption-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:48.360008 master-0 kubenswrapper[4807]: I1014 13:26:48.359890 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client" (OuterVolumeSpecName: "etcd-client") pod "3002128a-ef6f-4688-ab72-9f935bd4241d" (UID: "3002128a-ef6f-4688-ab72-9f935bd4241d"). InnerVolumeSpecName "etcd-client". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: I1014 13:26:48.383005 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-apiserver/apiserver-65499f9774-d4zpq"] Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: E1014 13:26:48.383266 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver-check-endpoints" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: I1014 13:26:48.383292 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver-check-endpoints" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: E1014 13:26:48.383332 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="fix-audit-permissions" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: I1014 13:26:48.383346 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="fix-audit-permissions" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: E1014 13:26:48.383368 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" Oct 14 13:26:48.383482 master-0 kubenswrapper[4807]: I1014 13:26:48.383382 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" Oct 14 13:26:48.384136 master-0 kubenswrapper[4807]: I1014 13:26:48.383549 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver-check-endpoints" Oct 14 13:26:48.384136 master-0 kubenswrapper[4807]: I1014 13:26:48.383577 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerName="openshift-apiserver" Oct 14 13:26:48.384702 master-0 kubenswrapper[4807]: I1014 13:26:48.384644 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.406336 master-0 kubenswrapper[4807]: I1014 13:26:48.406243 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-65499f9774-d4zpq"] Oct 14 13:26:48.459484 master-0 kubenswrapper[4807]: I1014 13:26:48.459402 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-audit-dir\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.459747 master-0 kubenswrapper[4807]: I1014 13:26:48.459515 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlx4n\" (UniqueName: \"kubernetes.io/projected/7b316bab-027b-45f5-b615-320d6977303e-kube-api-access-hlx4n\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.459747 master-0 kubenswrapper[4807]: I1014 13:26:48.459557 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-serving-cert\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.459747 master-0 kubenswrapper[4807]: I1014 13:26:48.459590 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-etcd-serving-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.459906 master-0 kubenswrapper[4807]: I1014 13:26:48.459825 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-image-import-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.459974 master-0 kubenswrapper[4807]: I1014 13:26:48.459941 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-etcd-client\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460046 master-0 kubenswrapper[4807]: I1014 13:26:48.460006 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-node-pullsecrets\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460167 master-0 kubenswrapper[4807]: I1014 13:26:48.460126 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-audit\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460203 master-0 kubenswrapper[4807]: I1014 13:26:48.460169 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-encryption-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460241 master-0 kubenswrapper[4807]: I1014 13:26:48.460204 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460241 master-0 kubenswrapper[4807]: I1014 13:26:48.460234 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-trusted-ca-bundle\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.460302 master-0 kubenswrapper[4807]: I1014 13:26:48.460285 4807 reconciler_common.go:293] "Volume detached for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-encryption-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.460335 master-0 kubenswrapper[4807]: I1014 13:26:48.460302 4807 reconciler_common.go:293] "Volume detached for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.460335 master-0 kubenswrapper[4807]: I1014 13:26:48.460315 4807 reconciler_common.go:293] "Volume detached for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/3002128a-ef6f-4688-ab72-9f935bd4241d-etcd-client\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.460335 master-0 kubenswrapper[4807]: I1014 13:26:48.460328 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pxbs5\" (UniqueName: \"kubernetes.io/projected/3002128a-ef6f-4688-ab72-9f935bd4241d-kube-api-access-pxbs5\") on node \"master-0\" DevicePath \"\"" Oct 14 13:26:48.537013 master-0 kubenswrapper[4807]: I1014 13:26:48.536880 4807 generic.go:334] "Generic (PLEG): container finished" podID="3002128a-ef6f-4688-ab72-9f935bd4241d" containerID="1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509" exitCode=0 Oct 14 13:26:48.537013 master-0 kubenswrapper[4807]: I1014 13:26:48.536965 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerDied","Data":"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509"} Oct 14 13:26:48.537013 master-0 kubenswrapper[4807]: I1014 13:26:48.537024 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" event={"ID":"3002128a-ef6f-4688-ab72-9f935bd4241d","Type":"ContainerDied","Data":"06c029e796ca65e2aadda42cfd4e031fed4093c948f26f02bf07ab055a3d15d3"} Oct 14 13:26:48.537632 master-0 kubenswrapper[4807]: I1014 13:26:48.537039 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-5f68d4c887-pqcgn" Oct 14 13:26:48.537632 master-0 kubenswrapper[4807]: I1014 13:26:48.537053 4807 scope.go:117] "RemoveContainer" containerID="a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199" Oct 14 13:26:48.562023 master-0 kubenswrapper[4807]: I1014 13:26:48.561856 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-audit-dir\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562023 master-0 kubenswrapper[4807]: I1014 13:26:48.561991 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-hlx4n\" (UniqueName: \"kubernetes.io/projected/7b316bab-027b-45f5-b615-320d6977303e-kube-api-access-hlx4n\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562031 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-audit-dir\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562047 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-serving-cert\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562158 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-etcd-serving-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562201 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-image-import-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562239 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-etcd-client\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562278 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-node-pullsecrets\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562313 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-audit\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562343 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-encryption-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.562383 master-0 kubenswrapper[4807]: I1014 13:26:48.562393 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.563418 master-0 kubenswrapper[4807]: I1014 13:26:48.562492 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-trusted-ca-bundle\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.563418 master-0 kubenswrapper[4807]: I1014 13:26:48.562679 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-pullsecrets\" (UniqueName: \"kubernetes.io/host-path/7b316bab-027b-45f5-b615-320d6977303e-node-pullsecrets\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.564561 master-0 kubenswrapper[4807]: I1014 13:26:48.564496 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"image-import-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-image-import-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.565175 master-0 kubenswrapper[4807]: I1014 13:26:48.565112 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-serving-ca\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-etcd-serving-ca\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.565175 master-0 kubenswrapper[4807]: I1014 13:26:48.565221 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.565766 master-0 kubenswrapper[4807]: I1014 13:26:48.565715 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-trusted-ca-bundle\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.565910 master-0 kubenswrapper[4807]: I1014 13:26:48.565875 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit\" (UniqueName: \"kubernetes.io/configmap/7b316bab-027b-45f5-b615-320d6977303e-audit\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.567434 master-0 kubenswrapper[4807]: I1014 13:26:48.567365 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"encryption-config\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-encryption-config\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.568146 master-0 kubenswrapper[4807]: I1014 13:26:48.568083 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etcd-client\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-etcd-client\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.568413 master-0 kubenswrapper[4807]: I1014 13:26:48.568363 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7b316bab-027b-45f5-b615-320d6977303e-serving-cert\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.575619 master-0 kubenswrapper[4807]: I1014 13:26:48.575574 4807 scope.go:117] "RemoveContainer" containerID="1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509" Oct 14 13:26:48.601937 master-0 kubenswrapper[4807]: I1014 13:26:48.601887 4807 scope.go:117] "RemoveContainer" containerID="7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be" Oct 14 13:26:48.628551 master-0 kubenswrapper[4807]: I1014 13:26:48.628492 4807 scope.go:117] "RemoveContainer" containerID="a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199" Oct 14 13:26:48.629157 master-0 kubenswrapper[4807]: E1014 13:26:48.629098 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199\": container with ID starting with a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199 not found: ID does not exist" containerID="a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199" Oct 14 13:26:48.629243 master-0 kubenswrapper[4807]: I1014 13:26:48.629163 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199"} err="failed to get container status \"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199\": rpc error: code = NotFound desc = could not find container \"a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199\": container with ID starting with a31ecac76bf9c7150cfb9e99cac00e6c37f0361aa113496df8de455183499199 not found: ID does not exist" Oct 14 13:26:48.629243 master-0 kubenswrapper[4807]: I1014 13:26:48.629204 4807 scope.go:117] "RemoveContainer" containerID="1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509" Oct 14 13:26:48.629972 master-0 kubenswrapper[4807]: E1014 13:26:48.629907 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509\": container with ID starting with 1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509 not found: ID does not exist" containerID="1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509" Oct 14 13:26:48.630093 master-0 kubenswrapper[4807]: I1014 13:26:48.629968 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509"} err="failed to get container status \"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509\": rpc error: code = NotFound desc = could not find container \"1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509\": container with ID starting with 1e80161a339973b4b5a1189e8811c65c50b85bad5ae5b1251e1d1e65e6ee4509 not found: ID does not exist" Oct 14 13:26:48.630093 master-0 kubenswrapper[4807]: I1014 13:26:48.630011 4807 scope.go:117] "RemoveContainer" containerID="7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be" Oct 14 13:26:48.632419 master-0 kubenswrapper[4807]: E1014 13:26:48.632368 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be\": container with ID starting with 7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be not found: ID does not exist" containerID="7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be" Oct 14 13:26:48.632419 master-0 kubenswrapper[4807]: I1014 13:26:48.632404 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be"} err="failed to get container status \"7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be\": rpc error: code = NotFound desc = could not find container \"7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be\": container with ID starting with 7e458a9148dfa4b1ac5930b4a4f8d31fd637d7ce407dd24cb0fe6f4393db92be not found: ID does not exist" Oct 14 13:26:48.650987 master-0 kubenswrapper[4807]: I1014 13:26:48.650840 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:26:48.658114 master-0 kubenswrapper[4807]: I1014 13:26:48.658052 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-apiserver/apiserver-5f68d4c887-pqcgn"] Oct 14 13:26:48.665727 master-0 kubenswrapper[4807]: I1014 13:26:48.665671 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlx4n\" (UniqueName: \"kubernetes.io/projected/7b316bab-027b-45f5-b615-320d6977303e-kube-api-access-hlx4n\") pod \"apiserver-65499f9774-d4zpq\" (UID: \"7b316bab-027b-45f5-b615-320d6977303e\") " pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:48.699715 master-0 kubenswrapper[4807]: I1014 13:26:48.699617 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:49.225743 master-0 kubenswrapper[4807]: I1014 13:26:49.225628 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-apiserver/apiserver-65499f9774-d4zpq"] Oct 14 13:26:49.242039 master-0 kubenswrapper[4807]: W1014 13:26:49.241954 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b316bab_027b_45f5_b615_320d6977303e.slice/crio-c501a0ba0a2ab592930a0717cb6f164166a6498a35744613666131f28baa2d98 WatchSource:0}: Error finding container c501a0ba0a2ab592930a0717cb6f164166a6498a35744613666131f28baa2d98: Status 404 returned error can't find the container with id c501a0ba0a2ab592930a0717cb6f164166a6498a35744613666131f28baa2d98 Oct 14 13:26:49.545491 master-0 kubenswrapper[4807]: I1014 13:26:49.545403 4807 generic.go:334] "Generic (PLEG): container finished" podID="7b316bab-027b-45f5-b615-320d6977303e" containerID="b41332aee071f47d4f7d69310e202714b3da55b2eed3d6652d13c8569e666f83" exitCode=0 Oct 14 13:26:49.546201 master-0 kubenswrapper[4807]: I1014 13:26:49.545494 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" event={"ID":"7b316bab-027b-45f5-b615-320d6977303e","Type":"ContainerDied","Data":"b41332aee071f47d4f7d69310e202714b3da55b2eed3d6652d13c8569e666f83"} Oct 14 13:26:49.546201 master-0 kubenswrapper[4807]: I1014 13:26:49.545554 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" event={"ID":"7b316bab-027b-45f5-b615-320d6977303e","Type":"ContainerStarted","Data":"c501a0ba0a2ab592930a0717cb6f164166a6498a35744613666131f28baa2d98"} Oct 14 13:26:50.270993 master-0 kubenswrapper[4807]: I1014 13:26:50.270726 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3002128a-ef6f-4688-ab72-9f935bd4241d" path="/var/lib/kubelet/pods/3002128a-ef6f-4688-ab72-9f935bd4241d/volumes" Oct 14 13:26:50.554845 master-0 kubenswrapper[4807]: I1014 13:26:50.554729 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" event={"ID":"7b316bab-027b-45f5-b615-320d6977303e","Type":"ContainerStarted","Data":"5a1c487f29a68255b8994979622fcdb1e365fccaed10ee9b6e06a13a3a25c550"} Oct 14 13:26:50.555395 master-0 kubenswrapper[4807]: I1014 13:26:50.555377 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" event={"ID":"7b316bab-027b-45f5-b615-320d6977303e","Type":"ContainerStarted","Data":"5761f27aa0e44c28e4c2e7f0daa5903b6a3e263327d7f7daeef0b2adbe73391b"} Oct 14 13:26:50.598541 master-0 kubenswrapper[4807]: I1014 13:26:50.598436 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" podStartSLOduration=113.598411053 podStartE2EDuration="1m53.598411053s" podCreationTimestamp="2025-10-14 13:24:57 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:26:50.595180482 +0000 UTC m=+405.276482346" watchObservedRunningTime="2025-10-14 13:26:50.598411053 +0000 UTC m=+405.279712887" Oct 14 13:26:53.699895 master-0 kubenswrapper[4807]: I1014 13:26:53.699805 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:53.701132 master-0 kubenswrapper[4807]: I1014 13:26:53.700202 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:53.712692 master-0 kubenswrapper[4807]: I1014 13:26:53.712611 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:26:54.589229 master-0 kubenswrapper[4807]: I1014 13:26:54.589103 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-apiserver/apiserver-65499f9774-d4zpq" Oct 14 13:28:05.847400 master-0 kubenswrapper[4807]: I1014 13:28:05.847320 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Oct 14 13:28:05.848158 master-0 kubenswrapper[4807]: I1014 13:28:05.848040 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:05.851825 master-0 kubenswrapper[4807]: I1014 13:28:05.851793 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-p7d8w" Oct 14 13:28:05.863222 master-0 kubenswrapper[4807]: I1014 13:28:05.863146 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Oct 14 13:28:06.015270 master-0 kubenswrapper[4807]: I1014 13:28:06.015168 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.015270 master-0 kubenswrapper[4807]: I1014 13:28:06.015257 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.015628 master-0 kubenswrapper[4807]: I1014 13:28:06.015315 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.117607 master-0 kubenswrapper[4807]: I1014 13:28:06.117524 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.117797 master-0 kubenswrapper[4807]: I1014 13:28:06.117633 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.117797 master-0 kubenswrapper[4807]: I1014 13:28:06.117725 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.117797 master-0 kubenswrapper[4807]: I1014 13:28:06.117756 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.117956 master-0 kubenswrapper[4807]: I1014 13:28:06.117894 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.153370 master-0 kubenswrapper[4807]: I1014 13:28:06.153307 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access\") pod \"installer-6-master-0\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.169966 master-0 kubenswrapper[4807]: I1014 13:28:06.169875 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-p7d8w" Oct 14 13:28:06.177205 master-0 kubenswrapper[4807]: I1014 13:28:06.177167 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:06.635497 master-0 kubenswrapper[4807]: I1014 13:28:06.635411 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/installer-6-master-0"] Oct 14 13:28:06.643280 master-0 kubenswrapper[4807]: W1014 13:28:06.643208 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod69346d61_8f26_4e98_9bc6_04a0c1f80685.slice/crio-b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34 WatchSource:0}: Error finding container b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34: Status 404 returned error can't find the container with id b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34 Oct 14 13:28:07.024980 master-0 kubenswrapper[4807]: I1014 13:28:07.024906 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"69346d61-8f26-4e98-9bc6-04a0c1f80685","Type":"ContainerStarted","Data":"b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34"} Oct 14 13:28:08.036225 master-0 kubenswrapper[4807]: I1014 13:28:08.036136 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"69346d61-8f26-4e98-9bc6-04a0c1f80685","Type":"ContainerStarted","Data":"041f673fe3aea636be99799cc58d19d5412a70365dd0ac165e075a76fe57223b"} Oct 14 13:28:08.068540 master-0 kubenswrapper[4807]: I1014 13:28:08.068411 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/installer-6-master-0" podStartSLOduration=3.068384388 podStartE2EDuration="3.068384388s" podCreationTimestamp="2025-10-14 13:28:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:28:08.067849223 +0000 UTC m=+482.749151137" watchObservedRunningTime="2025-10-14 13:28:08.068384388 +0000 UTC m=+482.749686212" Oct 14 13:28:13.289834 master-0 kubenswrapper[4807]: E1014 13:28:13.289682 4807 controller.go:195] "Failed to update lease" err="Put \"https://api-int.ocp.openstack.lab:6443/apis/coordination.k8s.io/v1/namespaces/kube-node-lease/leases/master-0?timeout=10s\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:28:28.853311 master-0 kubenswrapper[4807]: I1014 13:28:28.853267 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/lvms-operator-54844bd599-xsrzw"] Oct 14 13:28:28.854720 master-0 kubenswrapper[4807]: I1014 13:28:28.854702 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:28.857783 master-0 kubenswrapper[4807]: I1014 13:28:28.857738 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"openshift-service-ca.crt" Oct 14 13:28:28.857944 master-0 kubenswrapper[4807]: I1014 13:28:28.857920 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-storage"/"kube-root-ca.crt" Oct 14 13:28:28.858113 master-0 kubenswrapper[4807]: I1014 13:28:28.858088 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-service-cert" Oct 14 13:28:28.858255 master-0 kubenswrapper[4807]: I1014 13:28:28.858231 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-webhook-server-cert" Oct 14 13:28:28.859096 master-0 kubenswrapper[4807]: I1014 13:28:28.859063 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-metrics-cert" Oct 14 13:28:28.871779 master-0 kubenswrapper[4807]: I1014 13:28:28.871729 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-54844bd599-xsrzw"] Oct 14 13:28:28.943991 master-0 kubenswrapper[4807]: I1014 13:28:28.943897 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-socket-dir\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:28.943991 master-0 kubenswrapper[4807]: I1014 13:28:28.943978 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-webhook-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:28.944336 master-0 kubenswrapper[4807]: I1014 13:28:28.944031 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-apiservice-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:28.944336 master-0 kubenswrapper[4807]: I1014 13:28:28.944120 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-metrics-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:28.944336 master-0 kubenswrapper[4807]: I1014 13:28:28.944163 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pppkt\" (UniqueName: \"kubernetes.io/projected/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-kube-api-access-pppkt\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.045412 master-0 kubenswrapper[4807]: I1014 13:28:29.045267 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-metrics-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.045412 master-0 kubenswrapper[4807]: I1014 13:28:29.045362 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pppkt\" (UniqueName: \"kubernetes.io/projected/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-kube-api-access-pppkt\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.045869 master-0 kubenswrapper[4807]: I1014 13:28:29.045486 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-socket-dir\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.045869 master-0 kubenswrapper[4807]: I1014 13:28:29.045515 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-webhook-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.045869 master-0 kubenswrapper[4807]: I1014 13:28:29.045537 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-apiservice-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.046692 master-0 kubenswrapper[4807]: I1014 13:28:29.046626 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/empty-dir/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-socket-dir\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.049091 master-0 kubenswrapper[4807]: I1014 13:28:29.049013 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-metrics-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.049619 master-0 kubenswrapper[4807]: I1014 13:28:29.049571 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-apiservice-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.050044 master-0 kubenswrapper[4807]: I1014 13:28:29.049992 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-webhook-cert\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.065856 master-0 kubenswrapper[4807]: I1014 13:28:29.065795 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pppkt\" (UniqueName: \"kubernetes.io/projected/3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a-kube-api-access-pppkt\") pod \"lvms-operator-54844bd599-xsrzw\" (UID: \"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a\") " pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.168923 master-0 kubenswrapper[4807]: I1014 13:28:29.168734 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:29.643083 master-0 kubenswrapper[4807]: I1014 13:28:29.643011 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/lvms-operator-54844bd599-xsrzw"] Oct 14 13:28:29.658324 master-0 kubenswrapper[4807]: W1014 13:28:29.658218 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cae4ce9_691d_4b1a_ac5a_feb31b2cc20a.slice/crio-c68123c775c16777fe0d7f29ccad4bb5d7307296da79158fc3794657c139e87d WatchSource:0}: Error finding container c68123c775c16777fe0d7f29ccad4bb5d7307296da79158fc3794657c139e87d: Status 404 returned error can't find the container with id c68123c775c16777fe0d7f29ccad4bb5d7307296da79158fc3794657c139e87d Oct 14 13:28:29.661394 master-0 kubenswrapper[4807]: I1014 13:28:29.661337 4807 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 14 13:28:30.163482 master-0 kubenswrapper[4807]: I1014 13:28:30.163383 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" event={"ID":"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a","Type":"ContainerStarted","Data":"c68123c775c16777fe0d7f29ccad4bb5d7307296da79158fc3794657c139e87d"} Oct 14 13:28:36.203617 master-0 kubenswrapper[4807]: I1014 13:28:36.203547 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" event={"ID":"3cae4ce9-691d-4b1a-ac5a-feb31b2cc20a","Type":"ContainerStarted","Data":"c6bf2f30e235a7171ba4d5476c67d8c77d26117c0c15676789bc0f3f8a73b713"} Oct 14 13:28:36.204455 master-0 kubenswrapper[4807]: I1014 13:28:36.203979 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:36.208104 master-0 kubenswrapper[4807]: I1014 13:28:36.208039 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" Oct 14 13:28:36.286145 master-0 kubenswrapper[4807]: I1014 13:28:36.285270 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/lvms-operator-54844bd599-xsrzw" podStartSLOduration=2.172855772 podStartE2EDuration="8.28524737s" podCreationTimestamp="2025-10-14 13:28:28 +0000 UTC" firstStartedPulling="2025-10-14 13:28:29.661216504 +0000 UTC m=+504.342518328" lastFinishedPulling="2025-10-14 13:28:35.773608102 +0000 UTC m=+510.454909926" observedRunningTime="2025-10-14 13:28:36.238991348 +0000 UTC m=+510.920293212" watchObservedRunningTime="2025-10-14 13:28:36.28524737 +0000 UTC m=+510.966549194" Oct 14 13:28:36.821856 master-0 kubenswrapper[4807]: I1014 13:28:36.821781 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/revision-pruner-10-master-0"] Oct 14 13:28:36.822483 master-0 kubenswrapper[4807]: I1014 13:28:36.822421 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.826321 master-0 kubenswrapper[4807]: I1014 13:28:36.826277 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-xbs2c" Oct 14 13:28:36.838935 master-0 kubenswrapper[4807]: I1014 13:28:36.838865 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/revision-pruner-10-master-0"] Oct 14 13:28:36.851360 master-0 kubenswrapper[4807]: I1014 13:28:36.851268 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.851734 master-0 kubenswrapper[4807]: I1014 13:28:36.851515 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.953327 master-0 kubenswrapper[4807]: I1014 13:28:36.953018 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.953327 master-0 kubenswrapper[4807]: I1014 13:28:36.953285 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.953846 master-0 kubenswrapper[4807]: I1014 13:28:36.953414 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:36.989673 master-0 kubenswrapper[4807]: I1014 13:28:36.989572 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access\") pod \"revision-pruner-10-master-0\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:37.144728 master-0 kubenswrapper[4807]: I1014 13:28:37.144635 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:37.575975 master-0 kubenswrapper[4807]: I1014 13:28:37.575817 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/revision-pruner-10-master-0"] Oct 14 13:28:37.591404 master-0 kubenswrapper[4807]: W1014 13:28:37.591123 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a3af738_a42f_44ab_92b7_9f941ef04832.slice/crio-6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1 WatchSource:0}: Error finding container 6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1: Status 404 returned error can't find the container with id 6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1 Oct 14 13:28:38.222746 master-0 kubenswrapper[4807]: I1014 13:28:38.222661 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/revision-pruner-10-master-0" event={"ID":"6a3af738-a42f-44ab-92b7-9f941ef04832","Type":"ContainerStarted","Data":"5cb5089396c5a91a9239009c699cd0bc5193115b7c2cba297b403d3f0175339f"} Oct 14 13:28:38.222746 master-0 kubenswrapper[4807]: I1014 13:28:38.222729 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/revision-pruner-10-master-0" event={"ID":"6a3af738-a42f-44ab-92b7-9f941ef04832","Type":"ContainerStarted","Data":"6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1"} Oct 14 13:28:38.249236 master-0 kubenswrapper[4807]: I1014 13:28:38.249084 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/revision-pruner-10-master-0" podStartSLOduration=2.2490476839999998 podStartE2EDuration="2.249047684s" podCreationTimestamp="2025-10-14 13:28:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:28:38.244182248 +0000 UTC m=+512.925484112" watchObservedRunningTime="2025-10-14 13:28:38.249047684 +0000 UTC m=+512.930349548" Oct 14 13:28:39.228600 master-0 kubenswrapper[4807]: I1014 13:28:39.228515 4807 generic.go:334] "Generic (PLEG): container finished" podID="6a3af738-a42f-44ab-92b7-9f941ef04832" containerID="5cb5089396c5a91a9239009c699cd0bc5193115b7c2cba297b403d3f0175339f" exitCode=0 Oct 14 13:28:39.229328 master-0 kubenswrapper[4807]: I1014 13:28:39.228704 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/revision-pruner-10-master-0" event={"ID":"6a3af738-a42f-44ab-92b7-9f941ef04832","Type":"ContainerDied","Data":"5cb5089396c5a91a9239009c699cd0bc5193115b7c2cba297b403d3f0175339f"} Oct 14 13:28:40.617075 master-0 kubenswrapper[4807]: I1014 13:28:40.616971 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:40.722315 master-0 kubenswrapper[4807]: I1014 13:28:40.722230 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir\") pod \"6a3af738-a42f-44ab-92b7-9f941ef04832\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " Oct 14 13:28:40.722672 master-0 kubenswrapper[4807]: I1014 13:28:40.722338 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access\") pod \"6a3af738-a42f-44ab-92b7-9f941ef04832\" (UID: \"6a3af738-a42f-44ab-92b7-9f941ef04832\") " Oct 14 13:28:40.722672 master-0 kubenswrapper[4807]: I1014 13:28:40.722523 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "6a3af738-a42f-44ab-92b7-9f941ef04832" (UID: "6a3af738-a42f-44ab-92b7-9f941ef04832"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:28:40.722769 master-0 kubenswrapper[4807]: I1014 13:28:40.722691 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6a3af738-a42f-44ab-92b7-9f941ef04832-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:28:40.728732 master-0 kubenswrapper[4807]: I1014 13:28:40.728412 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "6a3af738-a42f-44ab-92b7-9f941ef04832" (UID: "6a3af738-a42f-44ab-92b7-9f941ef04832"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:28:40.824084 master-0 kubenswrapper[4807]: I1014 13:28:40.823882 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6a3af738-a42f-44ab-92b7-9f941ef04832-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:28:41.239613 master-0 kubenswrapper[4807]: I1014 13:28:41.239503 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/revision-pruner-10-master-0" event={"ID":"6a3af738-a42f-44ab-92b7-9f941ef04832","Type":"ContainerDied","Data":"6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1"} Oct 14 13:28:41.239613 master-0 kubenswrapper[4807]: I1014 13:28:41.239546 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/revision-pruner-10-master-0" Oct 14 13:28:41.239613 master-0 kubenswrapper[4807]: I1014 13:28:41.239566 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c723a8060220077a6a6107d3b500c01662863b62e5b88c1d12bed7b0bce3ba1" Oct 14 13:28:45.109323 master-0 kubenswrapper[4807]: I1014 13:28:45.109207 4807 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:28:45.109938 master-0 kubenswrapper[4807]: I1014 13:28:45.109667 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver" containerID="cri-o://dec5918ebbe7cb191e8c2bdaa2d0bd65a9239fcf84d289def1bc5626181876f2" gracePeriod=135 Oct 14 13:28:45.109938 master-0 kubenswrapper[4807]: I1014 13:28:45.109704 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-check-endpoints" containerID="cri-o://3ab81a7a646d8f6d5bcae00d5538afa1e6a01ee30e055c4fe670b2c146c7720b" gracePeriod=135 Oct 14 13:28:45.109938 master-0 kubenswrapper[4807]: I1014 13:28:45.109704 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-regeneration-controller" containerID="cri-o://c3cf45ef34f25e08c26b027a0766915776abd26c9522b9ac0f232df64f0e6c43" gracePeriod=135 Oct 14 13:28:45.109938 master-0 kubenswrapper[4807]: I1014 13:28:45.109765 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-syncer" containerID="cri-o://0e684b866a40c803a4fd7b32d2dd43092436b26316f3af5795b50321d753ebef" gracePeriod=135 Oct 14 13:28:45.109938 master-0 kubenswrapper[4807]: I1014 13:28:45.109863 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-insecure-readyz" containerID="cri-o://5c5daacfb0225fe961091c33b1dc83dfd171d82a17eb297f5b8ce555bc2aa238" gracePeriod=135 Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112248 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112509 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112526 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112541 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="setup" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112548 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="setup" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112563 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-syncer" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112571 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-syncer" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112580 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-check-endpoints" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112587 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-check-endpoints" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112595 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-regeneration-controller" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112602 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-regeneration-controller" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112614 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-insecure-readyz" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112620 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-insecure-readyz" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: E1014 13:28:45.112629 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6a3af738-a42f-44ab-92b7-9f941ef04832" containerName="pruner" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112635 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a3af738-a42f-44ab-92b7-9f941ef04832" containerName="pruner" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112736 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112750 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-insecure-readyz" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112761 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="6a3af738-a42f-44ab-92b7-9f941ef04832" containerName="pruner" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112771 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-check-endpoints" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112782 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-syncer" Oct 14 13:28:45.113057 master-0 kubenswrapper[4807]: I1014 13:28:45.112789 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="40c30bb582d8e7e3bec33943f1330ffc" containerName="kube-apiserver-cert-regeneration-controller" Oct 14 13:28:45.182929 master-0 kubenswrapper[4807]: I1014 13:28:45.182833 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.183241 master-0 kubenswrapper[4807]: I1014 13:28:45.183028 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.183404 master-0 kubenswrapper[4807]: I1014 13:28:45.183377 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.267534 master-0 kubenswrapper[4807]: I1014 13:28:45.267495 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_40c30bb582d8e7e3bec33943f1330ffc/kube-apiserver-cert-syncer/0.log" Oct 14 13:28:45.268324 master-0 kubenswrapper[4807]: I1014 13:28:45.268252 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="3ab81a7a646d8f6d5bcae00d5538afa1e6a01ee30e055c4fe670b2c146c7720b" exitCode=0 Oct 14 13:28:45.268324 master-0 kubenswrapper[4807]: I1014 13:28:45.268286 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="5c5daacfb0225fe961091c33b1dc83dfd171d82a17eb297f5b8ce555bc2aa238" exitCode=0 Oct 14 13:28:45.268324 master-0 kubenswrapper[4807]: I1014 13:28:45.268294 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="c3cf45ef34f25e08c26b027a0766915776abd26c9522b9ac0f232df64f0e6c43" exitCode=0 Oct 14 13:28:45.268324 master-0 kubenswrapper[4807]: I1014 13:28:45.268303 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="0e684b866a40c803a4fd7b32d2dd43092436b26316f3af5795b50321d753ebef" exitCode=2 Oct 14 13:28:45.284684 master-0 kubenswrapper[4807]: I1014 13:28:45.284274 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.284684 master-0 kubenswrapper[4807]: I1014 13:28:45.284388 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.284684 master-0 kubenswrapper[4807]: I1014 13:28:45.284556 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.284684 master-0 kubenswrapper[4807]: I1014 13:28:45.284687 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-cert-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.285140 master-0 kubenswrapper[4807]: I1014 13:28:45.284743 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-resource-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:45.285140 master-0 kubenswrapper[4807]: I1014 13:28:45.284775 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/08bb0ac7b01a53ae0dcb90ce8b66efa1-audit-dir\") pod \"kube-apiserver-master-0\" (UID: \"08bb0ac7b01a53ae0dcb90ce8b66efa1\") " pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:28:46.272191 master-0 kubenswrapper[4807]: I1014 13:28:46.271161 4807 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="40c30bb582d8e7e3bec33943f1330ffc" podUID="08bb0ac7b01a53ae0dcb90ce8b66efa1" Oct 14 13:28:46.277052 master-0 kubenswrapper[4807]: I1014 13:28:46.276993 4807 generic.go:334] "Generic (PLEG): container finished" podID="69346d61-8f26-4e98-9bc6-04a0c1f80685" containerID="041f673fe3aea636be99799cc58d19d5412a70365dd0ac165e075a76fe57223b" exitCode=0 Oct 14 13:28:46.277622 master-0 kubenswrapper[4807]: I1014 13:28:46.277542 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"69346d61-8f26-4e98-9bc6-04a0c1f80685","Type":"ContainerDied","Data":"041f673fe3aea636be99799cc58d19d5412a70365dd0ac165e075a76fe57223b"} Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: I1014 13:28:46.707116 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:28:46.709500 master-0 kubenswrapper[4807]: I1014 13:28:46.707297 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:28:47.618087 master-0 kubenswrapper[4807]: I1014 13:28:47.618017 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/installer-10-master-0"] Oct 14 13:28:47.618990 master-0 kubenswrapper[4807]: I1014 13:28:47.618765 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.621841 master-0 kubenswrapper[4807]: I1014 13:28:47.621751 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"installer-sa-dockercfg-xbs2c" Oct 14 13:28:47.645788 master-0 kubenswrapper[4807]: I1014 13:28:47.645661 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-10-master-0"] Oct 14 13:28:47.693185 master-0 kubenswrapper[4807]: I1014 13:28:47.693135 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:47.716673 master-0 kubenswrapper[4807]: I1014 13:28:47.716523 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.716673 master-0 kubenswrapper[4807]: I1014 13:28:47.716607 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.716673 master-0 kubenswrapper[4807]: I1014 13:28:47.716636 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.817715 master-0 kubenswrapper[4807]: I1014 13:28:47.817587 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir\") pod \"69346d61-8f26-4e98-9bc6-04a0c1f80685\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " Oct 14 13:28:47.817715 master-0 kubenswrapper[4807]: I1014 13:28:47.817676 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock\") pod \"69346d61-8f26-4e98-9bc6-04a0c1f80685\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.817854 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock" (OuterVolumeSpecName: "var-lock") pod "69346d61-8f26-4e98-9bc6-04a0c1f80685" (UID: "69346d61-8f26-4e98-9bc6-04a0c1f80685"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.817744 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access\") pod \"69346d61-8f26-4e98-9bc6-04a0c1f80685\" (UID: \"69346d61-8f26-4e98-9bc6-04a0c1f80685\") " Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.817875 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "69346d61-8f26-4e98-9bc6-04a0c1f80685" (UID: "69346d61-8f26-4e98-9bc6-04a0c1f80685"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818031 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818063 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818115 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818151 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818162 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/69346d61-8f26-4e98-9bc6-04a0c1f80685-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818232 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.818857 master-0 kubenswrapper[4807]: I1014 13:28:47.818250 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.821262 master-0 kubenswrapper[4807]: I1014 13:28:47.821091 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "69346d61-8f26-4e98-9bc6-04a0c1f80685" (UID: "69346d61-8f26-4e98-9bc6-04a0c1f80685"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:28:47.838067 master-0 kubenswrapper[4807]: I1014 13:28:47.838016 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access\") pod \"installer-10-master-0\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:47.919612 master-0 kubenswrapper[4807]: I1014 13:28:47.919368 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/69346d61-8f26-4e98-9bc6-04a0c1f80685-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:28:47.990942 master-0 kubenswrapper[4807]: I1014 13:28:47.990756 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-10-master-0" Oct 14 13:28:48.290541 master-0 kubenswrapper[4807]: I1014 13:28:48.290444 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/installer-6-master-0" event={"ID":"69346d61-8f26-4e98-9bc6-04a0c1f80685","Type":"ContainerDied","Data":"b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34"} Oct 14 13:28:48.290541 master-0 kubenswrapper[4807]: I1014 13:28:48.290518 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5e2f2c745569112c88bef0a2a134e3adc10bd8bb09e709e43eb028021172d34" Oct 14 13:28:48.290969 master-0 kubenswrapper[4807]: I1014 13:28:48.290562 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/installer-6-master-0" Oct 14 13:28:48.394317 master-0 kubenswrapper[4807]: I1014 13:28:48.394233 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-etcd/installer-10-master-0"] Oct 14 13:28:48.411356 master-0 kubenswrapper[4807]: W1014 13:28:48.411257 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podeb3f687c_2994_4dc5_8070_f641e02b4341.slice/crio-e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040 WatchSource:0}: Error finding container e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040: Status 404 returned error can't find the container with id e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040 Oct 14 13:28:49.296771 master-0 kubenswrapper[4807]: I1014 13:28:49.296694 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-10-master-0" event={"ID":"eb3f687c-2994-4dc5-8070-f641e02b4341","Type":"ContainerStarted","Data":"4dce5fbf3286b551af3846e5ffd27fa1641f7b1ebd805b5b0a423b349f908da0"} Oct 14 13:28:49.296771 master-0 kubenswrapper[4807]: I1014 13:28:49.296768 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-10-master-0" event={"ID":"eb3f687c-2994-4dc5-8070-f641e02b4341","Type":"ContainerStarted","Data":"e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040"} Oct 14 13:28:49.324886 master-0 kubenswrapper[4807]: I1014 13:28:49.324785 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/installer-10-master-0" podStartSLOduration=2.32475905 podStartE2EDuration="2.32475905s" podCreationTimestamp="2025-10-14 13:28:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:28:49.323905276 +0000 UTC m=+524.005207130" watchObservedRunningTime="2025-10-14 13:28:49.32475905 +0000 UTC m=+524.006060884" Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: I1014 13:28:51.706074 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:28:51.706155 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:28:51.708638 master-0 kubenswrapper[4807]: I1014 13:28:51.708591 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:28:54.715953 master-0 kubenswrapper[4807]: I1014 13:28:54.715858 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr"] Oct 14 13:28:54.717119 master-0 kubenswrapper[4807]: E1014 13:28:54.717094 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="69346d61-8f26-4e98-9bc6-04a0c1f80685" containerName="installer" Oct 14 13:28:54.717236 master-0 kubenswrapper[4807]: I1014 13:28:54.717220 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="69346d61-8f26-4e98-9bc6-04a0c1f80685" containerName="installer" Oct 14 13:28:54.717478 master-0 kubenswrapper[4807]: I1014 13:28:54.717439 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="69346d61-8f26-4e98-9bc6-04a0c1f80685" containerName="installer" Oct 14 13:28:54.718200 master-0 kubenswrapper[4807]: I1014 13:28:54.718174 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" Oct 14 13:28:54.723077 master-0 kubenswrapper[4807]: I1014 13:28:54.721065 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"openshift-service-ca.crt" Oct 14 13:28:54.723077 master-0 kubenswrapper[4807]: I1014 13:28:54.721348 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager-operator"/"kube-root-ca.crt" Oct 14 13:28:54.745577 master-0 kubenswrapper[4807]: I1014 13:28:54.745487 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr"] Oct 14 13:28:54.808819 master-0 kubenswrapper[4807]: I1014 13:28:54.808739 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpjq8\" (UniqueName: \"kubernetes.io/projected/d466bcd8-a198-4eb9-b4ce-94b877a018f9-kube-api-access-bpjq8\") pod \"cert-manager-operator-controller-manager-57cd46d6d-hrlnr\" (UID: \"d466bcd8-a198-4eb9-b4ce-94b877a018f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" Oct 14 13:28:54.909828 master-0 kubenswrapper[4807]: I1014 13:28:54.909741 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpjq8\" (UniqueName: \"kubernetes.io/projected/d466bcd8-a198-4eb9-b4ce-94b877a018f9-kube-api-access-bpjq8\") pod \"cert-manager-operator-controller-manager-57cd46d6d-hrlnr\" (UID: \"d466bcd8-a198-4eb9-b4ce-94b877a018f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" Oct 14 13:28:54.934565 master-0 kubenswrapper[4807]: I1014 13:28:54.933866 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpjq8\" (UniqueName: \"kubernetes.io/projected/d466bcd8-a198-4eb9-b4ce-94b877a018f9-kube-api-access-bpjq8\") pod \"cert-manager-operator-controller-manager-57cd46d6d-hrlnr\" (UID: \"d466bcd8-a198-4eb9-b4ce-94b877a018f9\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" Oct 14 13:28:55.035009 master-0 kubenswrapper[4807]: I1014 13:28:55.034836 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" Oct 14 13:28:55.483396 master-0 kubenswrapper[4807]: I1014 13:28:55.483293 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr"] Oct 14 13:28:56.349527 master-0 kubenswrapper[4807]: I1014 13:28:56.348603 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" event={"ID":"d466bcd8-a198-4eb9-b4ce-94b877a018f9","Type":"ContainerStarted","Data":"c752806cf6d31a5f6bbea6d243b44de234f958fdd34e3c851108f68bb31cd573"} Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: I1014 13:28:56.706754 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: I1014 13:28:56.706837 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:28:56.706963 master-0 kubenswrapper[4807]: I1014 13:28:56.706952 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: I1014 13:28:56.713655 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:28:56.713775 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:28:56.717378 master-0 kubenswrapper[4807]: I1014 13:28:56.713815 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: I1014 13:29:01.703317 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:01.703381 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:01.705194 master-0 kubenswrapper[4807]: I1014 13:29:01.703375 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:02.427050 master-0 kubenswrapper[4807]: I1014 13:29:02.426992 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" event={"ID":"d466bcd8-a198-4eb9-b4ce-94b877a018f9","Type":"ContainerStarted","Data":"9ca1c4edb439da59f6a11f38ccd9ba5663148618fbdf3c415abb1a0357fbed2b"} Oct 14 13:29:02.455621 master-0 kubenswrapper[4807]: I1014 13:29:02.455410 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-57cd46d6d-hrlnr" podStartSLOduration=2.379221564 podStartE2EDuration="8.455381512s" podCreationTimestamp="2025-10-14 13:28:54 +0000 UTC" firstStartedPulling="2025-10-14 13:28:55.501147602 +0000 UTC m=+530.182449426" lastFinishedPulling="2025-10-14 13:29:01.57730755 +0000 UTC m=+536.258609374" observedRunningTime="2025-10-14 13:29:02.450490894 +0000 UTC m=+537.131792758" watchObservedRunningTime="2025-10-14 13:29:02.455381512 +0000 UTC m=+537.136683376" Oct 14 13:29:04.647687 master-0 kubenswrapper[4807]: I1014 13:29:04.647620 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-d969966f-ddrnx"] Oct 14 13:29:04.648329 master-0 kubenswrapper[4807]: I1014 13:29:04.648311 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.651068 master-0 kubenswrapper[4807]: I1014 13:29:04.651028 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"openshift-service-ca.crt" Oct 14 13:29:04.651611 master-0 kubenswrapper[4807]: I1014 13:29:04.651581 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"cert-manager"/"kube-root-ca.crt" Oct 14 13:29:04.676007 master-0 kubenswrapper[4807]: I1014 13:29:04.675947 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-d969966f-ddrnx"] Oct 14 13:29:04.736733 master-0 kubenswrapper[4807]: I1014 13:29:04.736644 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7sqw\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-kube-api-access-f7sqw\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.736733 master-0 kubenswrapper[4807]: I1014 13:29:04.736731 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-bound-sa-token\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.837770 master-0 kubenswrapper[4807]: I1014 13:29:04.837678 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f7sqw\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-kube-api-access-f7sqw\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.838004 master-0 kubenswrapper[4807]: I1014 13:29:04.837783 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-bound-sa-token\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.856583 master-0 kubenswrapper[4807]: I1014 13:29:04.856516 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-bound-sa-token\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.870059 master-0 kubenswrapper[4807]: I1014 13:29:04.869992 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7sqw\" (UniqueName: \"kubernetes.io/projected/dc3a9813-3396-494a-b5ae-729b239c17bd-kube-api-access-f7sqw\") pod \"cert-manager-webhook-d969966f-ddrnx\" (UID: \"dc3a9813-3396-494a-b5ae-729b239c17bd\") " pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:04.979893 master-0 kubenswrapper[4807]: I1014 13:29:04.979696 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:05.251673 master-0 kubenswrapper[4807]: I1014 13:29:05.250632 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-d969966f-ddrnx"] Oct 14 13:29:05.268669 master-0 kubenswrapper[4807]: W1014 13:29:05.268520 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc3a9813_3396_494a_b5ae_729b239c17bd.slice/crio-f58a076ba8bfe823f17f2cea5c3470294996da32f2887ce20933982f045d3098 WatchSource:0}: Error finding container f58a076ba8bfe823f17f2cea5c3470294996da32f2887ce20933982f045d3098: Status 404 returned error can't find the container with id f58a076ba8bfe823f17f2cea5c3470294996da32f2887ce20933982f045d3098 Oct 14 13:29:05.446654 master-0 kubenswrapper[4807]: I1014 13:29:05.446586 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" event={"ID":"dc3a9813-3396-494a-b5ae-729b239c17bd","Type":"ContainerStarted","Data":"f58a076ba8bfe823f17f2cea5c3470294996da32f2887ce20933982f045d3098"} Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: I1014 13:29:06.712653 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:06.716511 master-0 kubenswrapper[4807]: I1014 13:29:06.712729 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:08.096873 master-0 kubenswrapper[4807]: I1014 13:29:08.095517 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj"] Oct 14 13:29:08.096873 master-0 kubenswrapper[4807]: I1014 13:29:08.096134 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.120595 master-0 kubenswrapper[4807]: I1014 13:29:08.120306 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj"] Oct 14 13:29:08.299487 master-0 kubenswrapper[4807]: I1014 13:29:08.299193 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmnz9\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-kube-api-access-zmnz9\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.299487 master-0 kubenswrapper[4807]: I1014 13:29:08.299306 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-bound-sa-token\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.400607 master-0 kubenswrapper[4807]: I1014 13:29:08.400526 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-bound-sa-token\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.400607 master-0 kubenswrapper[4807]: I1014 13:29:08.400618 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zmnz9\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-kube-api-access-zmnz9\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.420778 master-0 kubenswrapper[4807]: I1014 13:29:08.420716 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-bound-sa-token\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.423566 master-0 kubenswrapper[4807]: I1014 13:29:08.423520 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmnz9\" (UniqueName: \"kubernetes.io/projected/7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5-kube-api-access-zmnz9\") pod \"cert-manager-cainjector-7d9f95dbf-pxbjj\" (UID: \"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5\") " pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:08.719247 master-0 kubenswrapper[4807]: I1014 13:29:08.719064 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" Oct 14 13:29:10.031261 master-0 kubenswrapper[4807]: I1014 13:29:10.031100 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj"] Oct 14 13:29:10.042727 master-0 kubenswrapper[4807]: W1014 13:29:10.042662 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7df2b6e4_2b0e_4005_ab5c_0ab05ade8fc5.slice/crio-d318f83559d98a50a9885a89caea821c0b91f8d72027d367f6a68a41f430eb89 WatchSource:0}: Error finding container d318f83559d98a50a9885a89caea821c0b91f8d72027d367f6a68a41f430eb89: Status 404 returned error can't find the container with id d318f83559d98a50a9885a89caea821c0b91f8d72027d367f6a68a41f430eb89 Oct 14 13:29:10.474920 master-0 kubenswrapper[4807]: I1014 13:29:10.474837 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" event={"ID":"dc3a9813-3396-494a-b5ae-729b239c17bd","Type":"ContainerStarted","Data":"27990a6ec1fc771b7b502c060ad7f9fa91d1b63cc689f7fe4a3fecce980e1220"} Oct 14 13:29:10.474920 master-0 kubenswrapper[4807]: I1014 13:29:10.474921 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:10.477549 master-0 kubenswrapper[4807]: I1014 13:29:10.477469 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" event={"ID":"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5","Type":"ContainerStarted","Data":"f50ffdf714b706bb8f122c8fe21b548727425b498f14d4a3e26d6bb5fbe4b295"} Oct 14 13:29:10.477549 master-0 kubenswrapper[4807]: I1014 13:29:10.477552 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" event={"ID":"7df2b6e4-2b0e-4005-ab5c-0ab05ade8fc5","Type":"ContainerStarted","Data":"d318f83559d98a50a9885a89caea821c0b91f8d72027d367f6a68a41f430eb89"} Oct 14 13:29:10.497378 master-0 kubenswrapper[4807]: I1014 13:29:10.497264 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" podStartSLOduration=2.095781096 podStartE2EDuration="6.497243836s" podCreationTimestamp="2025-10-14 13:29:04 +0000 UTC" firstStartedPulling="2025-10-14 13:29:05.283549868 +0000 UTC m=+539.964851692" lastFinishedPulling="2025-10-14 13:29:09.685012578 +0000 UTC m=+544.366314432" observedRunningTime="2025-10-14 13:29:10.496550056 +0000 UTC m=+545.177851900" watchObservedRunningTime="2025-10-14 13:29:10.497243836 +0000 UTC m=+545.178545660" Oct 14 13:29:10.517409 master-0 kubenswrapper[4807]: I1014 13:29:10.517302 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-7d9f95dbf-pxbjj" podStartSLOduration=2.51727146 podStartE2EDuration="2.51727146s" podCreationTimestamp="2025-10-14 13:29:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:29:10.514588895 +0000 UTC m=+545.195890739" watchObservedRunningTime="2025-10-14 13:29:10.51727146 +0000 UTC m=+545.198573314" Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: I1014 13:29:11.704038 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:11.704104 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:11.705717 master-0 kubenswrapper[4807]: I1014 13:29:11.704111 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:14.984235 master-0 kubenswrapper[4807]: I1014 13:29:14.984144 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-d969966f-ddrnx" Oct 14 13:29:15.440810 master-0 kubenswrapper[4807]: I1014 13:29:15.440687 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-controller-manager-6479dd8558-s545w"] Oct 14 13:29:15.441557 master-0 kubenswrapper[4807]: I1014 13:29:15.441530 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.443956 master-0 kubenswrapper[4807]: I1014 13:29:15.443923 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-controller-manager-service-cert" Oct 14 13:29:15.444388 master-0 kubenswrapper[4807]: I1014 13:29:15.444355 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-cert" Oct 14 13:29:15.444629 master-0 kubenswrapper[4807]: I1014 13:29:15.444606 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"kube-root-ca.crt" Oct 14 13:29:15.447834 master-0 kubenswrapper[4807]: I1014 13:29:15.447778 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"openshift-service-ca.crt" Oct 14 13:29:15.470850 master-0 kubenswrapper[4807]: I1014 13:29:15.470791 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6479dd8558-s545w"] Oct 14 13:29:15.514816 master-0 kubenswrapper[4807]: I1014 13:29:15.514745 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-apiservice-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.514816 master-0 kubenswrapper[4807]: I1014 13:29:15.514805 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4rd6\" (UniqueName: \"kubernetes.io/projected/08bcb56b-d815-4c79-947b-587268bc009f-kube-api-access-d4rd6\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.515131 master-0 kubenswrapper[4807]: I1014 13:29:15.514839 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-webhook-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.616711 master-0 kubenswrapper[4807]: I1014 13:29:15.616615 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-apiservice-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.617067 master-0 kubenswrapper[4807]: I1014 13:29:15.616802 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d4rd6\" (UniqueName: \"kubernetes.io/projected/08bcb56b-d815-4c79-947b-587268bc009f-kube-api-access-d4rd6\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.617718 master-0 kubenswrapper[4807]: I1014 13:29:15.617657 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-webhook-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.622867 master-0 kubenswrapper[4807]: I1014 13:29:15.622812 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-apiservice-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.623874 master-0 kubenswrapper[4807]: I1014 13:29:15.623818 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/08bcb56b-d815-4c79-947b-587268bc009f-webhook-cert\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.648150 master-0 kubenswrapper[4807]: I1014 13:29:15.648096 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4rd6\" (UniqueName: \"kubernetes.io/projected/08bcb56b-d815-4c79-947b-587268bc009f-kube-api-access-d4rd6\") pod \"metallb-operator-controller-manager-6479dd8558-s545w\" (UID: \"08bcb56b-d815-4c79-947b-587268bc009f\") " pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.711017 master-0 kubenswrapper[4807]: I1014 13:29:15.710852 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d"] Oct 14 13:29:15.711631 master-0 kubenswrapper[4807]: I1014 13:29:15.711600 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.714020 master-0 kubenswrapper[4807]: I1014 13:29:15.713975 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Oct 14 13:29:15.715775 master-0 kubenswrapper[4807]: I1014 13:29:15.715722 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-service-cert" Oct 14 13:29:15.766903 master-0 kubenswrapper[4807]: I1014 13:29:15.766843 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:15.779529 master-0 kubenswrapper[4807]: I1014 13:29:15.775125 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d"] Oct 14 13:29:15.821342 master-0 kubenswrapper[4807]: I1014 13:29:15.821278 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-webhook-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.821671 master-0 kubenswrapper[4807]: I1014 13:29:15.821407 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-apiservice-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.821671 master-0 kubenswrapper[4807]: I1014 13:29:15.821499 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5t7n\" (UniqueName: \"kubernetes.io/projected/b04933b1-7908-4c4d-be70-59b27ed5b313-kube-api-access-b5t7n\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.922851 master-0 kubenswrapper[4807]: I1014 13:29:15.922774 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-apiservice-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.922851 master-0 kubenswrapper[4807]: I1014 13:29:15.922858 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-b5t7n\" (UniqueName: \"kubernetes.io/projected/b04933b1-7908-4c4d-be70-59b27ed5b313-kube-api-access-b5t7n\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.923795 master-0 kubenswrapper[4807]: I1014 13:29:15.922891 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-webhook-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.926233 master-0 kubenswrapper[4807]: I1014 13:29:15.926181 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-apiservice-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.931757 master-0 kubenswrapper[4807]: I1014 13:29:15.931409 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b04933b1-7908-4c4d-be70-59b27ed5b313-webhook-cert\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:15.959076 master-0 kubenswrapper[4807]: I1014 13:29:15.958999 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5t7n\" (UniqueName: \"kubernetes.io/projected/b04933b1-7908-4c4d-be70-59b27ed5b313-kube-api-access-b5t7n\") pod \"metallb-operator-webhook-server-6d98fdfb58-5gp8d\" (UID: \"b04933b1-7908-4c4d-be70-59b27ed5b313\") " pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:16.036289 master-0 kubenswrapper[4807]: I1014 13:29:16.036101 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:16.138162 master-0 kubenswrapper[4807]: I1014 13:29:16.138108 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h"] Oct 14 13:29:16.138845 master-0 kubenswrapper[4807]: I1014 13:29:16.138815 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" Oct 14 13:29:16.142562 master-0 kubenswrapper[4807]: I1014 13:29:16.142511 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"kube-root-ca.crt" Oct 14 13:29:16.143349 master-0 kubenswrapper[4807]: I1014 13:29:16.143324 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-operators"/"openshift-service-ca.crt" Oct 14 13:29:16.170664 master-0 kubenswrapper[4807]: I1014 13:29:16.170597 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h"] Oct 14 13:29:16.218291 master-0 kubenswrapper[4807]: I1014 13:29:16.218217 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-controller-manager-6479dd8558-s545w"] Oct 14 13:29:16.228446 master-0 kubenswrapper[4807]: I1014 13:29:16.228333 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsmvq\" (UniqueName: \"kubernetes.io/projected/a7585e35-2222-474a-af4c-2acca34586e3-kube-api-access-vsmvq\") pod \"obo-prometheus-operator-7c8cf85677-w5k2h\" (UID: \"a7585e35-2222-474a-af4c-2acca34586e3\") " pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" Oct 14 13:29:16.229568 master-0 kubenswrapper[4807]: W1014 13:29:16.229509 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08bcb56b_d815_4c79_947b_587268bc009f.slice/crio-94f69e4e71951a13fb82bac11d04b6034de55457359906651d92cb1e60d1862c WatchSource:0}: Error finding container 94f69e4e71951a13fb82bac11d04b6034de55457359906651d92cb1e60d1862c: Status 404 returned error can't find the container with id 94f69e4e71951a13fb82bac11d04b6034de55457359906651d92cb1e60d1862c Oct 14 13:29:16.296193 master-0 kubenswrapper[4807]: I1014 13:29:16.296058 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd"] Oct 14 13:29:16.297086 master-0 kubenswrapper[4807]: I1014 13:29:16.297029 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.300816 master-0 kubenswrapper[4807]: I1014 13:29:16.299297 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-service-cert" Oct 14 13:29:16.325403 master-0 kubenswrapper[4807]: I1014 13:29:16.325335 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd"] Oct 14 13:29:16.332136 master-0 kubenswrapper[4807]: I1014 13:29:16.332049 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vsmvq\" (UniqueName: \"kubernetes.io/projected/a7585e35-2222-474a-af4c-2acca34586e3-kube-api-access-vsmvq\") pod \"obo-prometheus-operator-7c8cf85677-w5k2h\" (UID: \"a7585e35-2222-474a-af4c-2acca34586e3\") " pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" Oct 14 13:29:16.354558 master-0 kubenswrapper[4807]: I1014 13:29:16.354388 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsmvq\" (UniqueName: \"kubernetes.io/projected/a7585e35-2222-474a-af4c-2acca34586e3-kube-api-access-vsmvq\") pod \"obo-prometheus-operator-7c8cf85677-w5k2h\" (UID: \"a7585e35-2222-474a-af4c-2acca34586e3\") " pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" Oct 14 13:29:16.434624 master-0 kubenswrapper[4807]: I1014 13:29:16.433022 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.434624 master-0 kubenswrapper[4807]: I1014 13:29:16.433283 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.459709 master-0 kubenswrapper[4807]: I1014 13:29:16.459641 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" Oct 14 13:29:16.461774 master-0 kubenswrapper[4807]: I1014 13:29:16.461721 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d"] Oct 14 13:29:16.467758 master-0 kubenswrapper[4807]: W1014 13:29:16.467719 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb04933b1_7908_4c4d_be70_59b27ed5b313.slice/crio-c69d9a687818f4588ba546b092c40b74a5735a7a8f0c93316b53573852e0aaf9 WatchSource:0}: Error finding container c69d9a687818f4588ba546b092c40b74a5735a7a8f0c93316b53573852e0aaf9: Status 404 returned error can't find the container with id c69d9a687818f4588ba546b092c40b74a5735a7a8f0c93316b53573852e0aaf9 Oct 14 13:29:16.496331 master-0 kubenswrapper[4807]: I1014 13:29:16.495914 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/observability-operator-cc5f78dfc-xm62s"] Oct 14 13:29:16.496777 master-0 kubenswrapper[4807]: I1014 13:29:16.496635 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.499283 master-0 kubenswrapper[4807]: I1014 13:29:16.499209 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-tls" Oct 14 13:29:16.514288 master-0 kubenswrapper[4807]: I1014 13:29:16.514227 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" event={"ID":"b04933b1-7908-4c4d-be70-59b27ed5b313","Type":"ContainerStarted","Data":"c69d9a687818f4588ba546b092c40b74a5735a7a8f0c93316b53573852e0aaf9"} Oct 14 13:29:16.515814 master-0 kubenswrapper[4807]: I1014 13:29:16.515774 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" event={"ID":"08bcb56b-d815-4c79-947b-587268bc009f","Type":"ContainerStarted","Data":"94f69e4e71951a13fb82bac11d04b6034de55457359906651d92cb1e60d1862c"} Oct 14 13:29:16.524116 master-0 kubenswrapper[4807]: I1014 13:29:16.524052 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-cc5f78dfc-xm62s"] Oct 14 13:29:16.534312 master-0 kubenswrapper[4807]: I1014 13:29:16.534261 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.534312 master-0 kubenswrapper[4807]: I1014 13:29:16.534314 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.537584 master-0 kubenswrapper[4807]: I1014 13:29:16.537542 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-apiservice-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.538485 master-0 kubenswrapper[4807]: I1014 13:29:16.538408 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/62446d23-1f4e-40b6-bb45-129fd33c602b-webhook-cert\") pod \"obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd\" (UID: \"62446d23-1f4e-40b6-bb45-129fd33c602b\") " pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.621316 master-0 kubenswrapper[4807]: I1014 13:29:16.621238 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" Oct 14 13:29:16.635593 master-0 kubenswrapper[4807]: I1014 13:29:16.635535 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89hhb\" (UniqueName: \"kubernetes.io/projected/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-kube-api-access-89hhb\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.635665 master-0 kubenswrapper[4807]: I1014 13:29:16.635609 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-observability-operator-tls\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: I1014 13:29:16.709711 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:16.710287 master-0 kubenswrapper[4807]: I1014 13:29:16.709807 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:16.738780 master-0 kubenswrapper[4807]: I1014 13:29:16.738555 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-observability-operator-tls\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.738780 master-0 kubenswrapper[4807]: I1014 13:29:16.738724 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-89hhb\" (UniqueName: \"kubernetes.io/projected/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-kube-api-access-89hhb\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.749434 master-0 kubenswrapper[4807]: I1014 13:29:16.749222 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"observability-operator-tls\" (UniqueName: \"kubernetes.io/secret/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-observability-operator-tls\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.755169 master-0 kubenswrapper[4807]: I1014 13:29:16.755111 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-operators/perses-operator-54bc95c9fb-k5626"] Oct 14 13:29:16.758302 master-0 kubenswrapper[4807]: I1014 13:29:16.758270 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:16.772294 master-0 kubenswrapper[4807]: I1014 13:29:16.772257 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-89hhb\" (UniqueName: \"kubernetes.io/projected/9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35-kube-api-access-89hhb\") pod \"observability-operator-cc5f78dfc-xm62s\" (UID: \"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35\") " pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.774052 master-0 kubenswrapper[4807]: I1014 13:29:16.773981 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-54bc95c9fb-k5626"] Oct 14 13:29:16.812917 master-0 kubenswrapper[4807]: I1014 13:29:16.812087 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:16.873572 master-0 kubenswrapper[4807]: I1014 13:29:16.873526 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h"] Oct 14 13:29:16.942573 master-0 kubenswrapper[4807]: I1014 13:29:16.942501 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92wj5\" (UniqueName: \"kubernetes.io/projected/957d9493-9e2c-491d-a7df-051f69180f41-kube-api-access-92wj5\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:16.942961 master-0 kubenswrapper[4807]: I1014 13:29:16.942929 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/957d9493-9e2c-491d-a7df-051f69180f41-openshift-service-ca\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.030480 master-0 kubenswrapper[4807]: I1014 13:29:17.030278 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd"] Oct 14 13:29:17.036369 master-0 kubenswrapper[4807]: W1014 13:29:17.036332 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62446d23_1f4e_40b6_bb45_129fd33c602b.slice/crio-1629b13ba7f5c0f897520489591dfd82984cacc3e4bfd02cef389ee468a17bf8 WatchSource:0}: Error finding container 1629b13ba7f5c0f897520489591dfd82984cacc3e4bfd02cef389ee468a17bf8: Status 404 returned error can't find the container with id 1629b13ba7f5c0f897520489591dfd82984cacc3e4bfd02cef389ee468a17bf8 Oct 14 13:29:17.044335 master-0 kubenswrapper[4807]: I1014 13:29:17.044299 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-92wj5\" (UniqueName: \"kubernetes.io/projected/957d9493-9e2c-491d-a7df-051f69180f41-kube-api-access-92wj5\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.044545 master-0 kubenswrapper[4807]: I1014 13:29:17.044516 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/957d9493-9e2c-491d-a7df-051f69180f41-openshift-service-ca\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.045787 master-0 kubenswrapper[4807]: I1014 13:29:17.045754 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/957d9493-9e2c-491d-a7df-051f69180f41-openshift-service-ca\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.067590 master-0 kubenswrapper[4807]: I1014 13:29:17.067451 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wj5\" (UniqueName: \"kubernetes.io/projected/957d9493-9e2c-491d-a7df-051f69180f41-kube-api-access-92wj5\") pod \"perses-operator-54bc95c9fb-k5626\" (UID: \"957d9493-9e2c-491d-a7df-051f69180f41\") " pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.087834 master-0 kubenswrapper[4807]: I1014 13:29:17.087742 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:17.221284 master-0 kubenswrapper[4807]: I1014 13:29:17.221206 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/observability-operator-cc5f78dfc-xm62s"] Oct 14 13:29:17.527274 master-0 kubenswrapper[4807]: I1014 13:29:17.527174 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" event={"ID":"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35","Type":"ContainerStarted","Data":"d51d42394a6db908206eb50f913400376bebf02b1ef1b3440f4371e4b5e575d9"} Oct 14 13:29:17.529261 master-0 kubenswrapper[4807]: I1014 13:29:17.528962 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" event={"ID":"a7585e35-2222-474a-af4c-2acca34586e3","Type":"ContainerStarted","Data":"fe686b8bb6742a04863d18eceb73252ed3bc9e6475eba892c8444d744825cb96"} Oct 14 13:29:17.532326 master-0 kubenswrapper[4807]: I1014 13:29:17.532248 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" event={"ID":"62446d23-1f4e-40b6-bb45-129fd33c602b","Type":"ContainerStarted","Data":"1629b13ba7f5c0f897520489591dfd82984cacc3e4bfd02cef389ee468a17bf8"} Oct 14 13:29:17.536388 master-0 kubenswrapper[4807]: I1014 13:29:17.536253 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-operators/perses-operator-54bc95c9fb-k5626"] Oct 14 13:29:17.546659 master-0 kubenswrapper[4807]: W1014 13:29:17.546604 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod957d9493_9e2c_491d_a7df_051f69180f41.slice/crio-1da054c6f214d59f8dc41b737d7b4acc606151448067bb1c4ab5df8f3abc1ad9 WatchSource:0}: Error finding container 1da054c6f214d59f8dc41b737d7b4acc606151448067bb1c4ab5df8f3abc1ad9: Status 404 returned error can't find the container with id 1da054c6f214d59f8dc41b737d7b4acc606151448067bb1c4ab5df8f3abc1ad9 Oct 14 13:29:18.240031 master-0 kubenswrapper[4807]: I1014 13:29:18.239253 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t"] Oct 14 13:29:18.240031 master-0 kubenswrapper[4807]: I1014 13:29:18.239963 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" Oct 14 13:29:18.251119 master-0 kubenswrapper[4807]: I1014 13:29:18.251063 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"openshift-service-ca.crt" Oct 14 13:29:18.251119 master-0 kubenswrapper[4807]: I1014 13:29:18.251105 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-nmstate"/"kube-root-ca.crt" Oct 14 13:29:18.260706 master-0 kubenswrapper[4807]: I1014 13:29:18.260614 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mq69p\" (UniqueName: \"kubernetes.io/projected/9e163479-33bf-42a3-9e83-f97d58c5fc56-kube-api-access-mq69p\") pod \"nmstate-operator-858ddd8f98-7gf7t\" (UID: \"9e163479-33bf-42a3-9e83-f97d58c5fc56\") " pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" Oct 14 13:29:18.260706 master-0 kubenswrapper[4807]: I1014 13:29:18.260645 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t"] Oct 14 13:29:18.362179 master-0 kubenswrapper[4807]: I1014 13:29:18.362087 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mq69p\" (UniqueName: \"kubernetes.io/projected/9e163479-33bf-42a3-9e83-f97d58c5fc56-kube-api-access-mq69p\") pod \"nmstate-operator-858ddd8f98-7gf7t\" (UID: \"9e163479-33bf-42a3-9e83-f97d58c5fc56\") " pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" Oct 14 13:29:18.404845 master-0 kubenswrapper[4807]: I1014 13:29:18.404782 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mq69p\" (UniqueName: \"kubernetes.io/projected/9e163479-33bf-42a3-9e83-f97d58c5fc56-kube-api-access-mq69p\") pod \"nmstate-operator-858ddd8f98-7gf7t\" (UID: \"9e163479-33bf-42a3-9e83-f97d58c5fc56\") " pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" Oct 14 13:29:18.542569 master-0 kubenswrapper[4807]: I1014 13:29:18.542333 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" event={"ID":"957d9493-9e2c-491d-a7df-051f69180f41","Type":"ContainerStarted","Data":"1da054c6f214d59f8dc41b737d7b4acc606151448067bb1c4ab5df8f3abc1ad9"} Oct 14 13:29:18.565576 master-0 kubenswrapper[4807]: I1014 13:29:18.559711 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" Oct 14 13:29:19.915740 master-0 kubenswrapper[4807]: I1014 13:29:19.915677 4807 kubelet.go:2431] "SyncLoop REMOVE" source="file" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:29:19.916410 master-0 kubenswrapper[4807]: I1014 13:29:19.916084 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcdctl" containerID="cri-o://052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" gracePeriod=30 Oct 14 13:29:19.916410 master-0 kubenswrapper[4807]: I1014 13:29:19.916103 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" containerID="cri-o://876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" gracePeriod=30 Oct 14 13:29:19.916410 master-0 kubenswrapper[4807]: I1014 13:29:19.916134 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-readyz" containerID="cri-o://ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" gracePeriod=30 Oct 14 13:29:19.916410 master-0 kubenswrapper[4807]: I1014 13:29:19.916269 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-metrics" containerID="cri-o://7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" gracePeriod=30 Oct 14 13:29:19.916410 master-0 kubenswrapper[4807]: I1014 13:29:19.916251 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-etcd/etcd-master-0" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-rev" containerID="cri-o://c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" gracePeriod=30 Oct 14 13:29:19.918050 master-0 kubenswrapper[4807]: I1014 13:29:19.918021 4807 kubelet.go:2421] "SyncLoop ADD" source="file" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:29:19.918246 master-0 kubenswrapper[4807]: E1014 13:29:19.918224 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918293 master-0 kubenswrapper[4807]: I1014 13:29:19.918245 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918293 master-0 kubenswrapper[4807]: E1014 13:29:19.918265 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918293 master-0 kubenswrapper[4807]: I1014 13:29:19.918272 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918293 master-0 kubenswrapper[4807]: E1014 13:29:19.918284 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-ensure-env-vars" Oct 14 13:29:19.918293 master-0 kubenswrapper[4807]: I1014 13:29:19.918292 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-ensure-env-vars" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918304 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918312 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918323 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-readyz" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918329 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-readyz" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918344 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="setup" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918352 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="setup" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918366 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-resources-copy" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918375 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-resources-copy" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918383 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcdctl" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918389 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcdctl" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918396 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-rev" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918403 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-rev" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: E1014 13:29:19.918411 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-metrics" Oct 14 13:29:19.918444 master-0 kubenswrapper[4807]: I1014 13:29:19.918417 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-metrics" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918526 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918543 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-readyz" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918551 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-metrics" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918561 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcdctl" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918569 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd-rev" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918578 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:19.918917 master-0 kubenswrapper[4807]: I1014 13:29:19.918750 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a7e53a8977ce5fc5588aef94f91dcc24" containerName="etcd" Oct 14 13:29:20.020521 master-0 kubenswrapper[4807]: I1014 13:29:20.020358 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-usr-local-bin\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.020521 master-0 kubenswrapper[4807]: I1014 13:29:20.020414 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-static-pod-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.020521 master-0 kubenswrapper[4807]: I1014 13:29:20.020450 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-resource-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.020919 master-0 kubenswrapper[4807]: I1014 13:29:20.020636 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-log-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.020919 master-0 kubenswrapper[4807]: I1014 13:29:20.020701 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-data-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.020919 master-0 kubenswrapper[4807]: I1014 13:29:20.020797 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-cert-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122196 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-usr-local-bin\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122275 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-static-pod-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122311 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-resource-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122343 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-log-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122360 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-data-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122348 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-usr-local-bin\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122428 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-cert-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122382 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-cert-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122487 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-resource-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122448 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-static-pod-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122531 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-log-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.122574 master-0 kubenswrapper[4807]: I1014 13:29:20.122540 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/14286286be88b59efc7cfc15eca1cc38-data-dir\") pod \"etcd-master-0\" (UID: \"14286286be88b59efc7cfc15eca1cc38\") " pod="openshift-etcd/etcd-master-0" Oct 14 13:29:20.560361 master-0 kubenswrapper[4807]: I1014 13:29:20.556220 4807 generic.go:334] "Generic (PLEG): container finished" podID="eb3f687c-2994-4dc5-8070-f641e02b4341" containerID="4dce5fbf3286b551af3846e5ffd27fa1641f7b1ebd805b5b0a423b349f908da0" exitCode=0 Oct 14 13:29:20.560361 master-0 kubenswrapper[4807]: I1014 13:29:20.556323 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-10-master-0" event={"ID":"eb3f687c-2994-4dc5-8070-f641e02b4341","Type":"ContainerDied","Data":"4dce5fbf3286b551af3846e5ffd27fa1641f7b1ebd805b5b0a423b349f908da0"} Oct 14 13:29:20.560361 master-0 kubenswrapper[4807]: I1014 13:29:20.558742 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:29:20.560361 master-0 kubenswrapper[4807]: I1014 13:29:20.559324 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-rev/0.log" Oct 14 13:29:20.560802 master-0 kubenswrapper[4807]: I1014 13:29:20.560546 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-metrics/0.log" Oct 14 13:29:20.563351 master-0 kubenswrapper[4807]: I1014 13:29:20.563141 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" exitCode=2 Oct 14 13:29:20.563351 master-0 kubenswrapper[4807]: I1014 13:29:20.563302 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" exitCode=0 Oct 14 13:29:20.563351 master-0 kubenswrapper[4807]: I1014 13:29:20.563319 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" exitCode=2 Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: I1014 13:29:21.705534 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:21.705611 master-0 kubenswrapper[4807]: I1014 13:29:21.705613 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:23.457919 master-0 kubenswrapper[4807]: I1014 13:29:23.457841 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-7d4cc89fcb-mcxbx"] Oct 14 13:29:23.458662 master-0 kubenswrapper[4807]: I1014 13:29:23.458624 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.485010 master-0 kubenswrapper[4807]: I1014 13:29:23.484945 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-7d4cc89fcb-mcxbx"] Oct 14 13:29:23.487289 master-0 kubenswrapper[4807]: I1014 13:29:23.487222 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g9rr\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-kube-api-access-6g9rr\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.487439 master-0 kubenswrapper[4807]: I1014 13:29:23.487336 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-bound-sa-token\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.588697 master-0 kubenswrapper[4807]: I1014 13:29:23.588610 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6g9rr\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-kube-api-access-6g9rr\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.588970 master-0 kubenswrapper[4807]: I1014 13:29:23.588716 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-bound-sa-token\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.610910 master-0 kubenswrapper[4807]: I1014 13:29:23.610802 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g9rr\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-kube-api-access-6g9rr\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.613021 master-0 kubenswrapper[4807]: I1014 13:29:23.612948 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/654a7d43-76e0-4929-85b5-50434664acb7-bound-sa-token\") pod \"cert-manager-7d4cc89fcb-mcxbx\" (UID: \"654a7d43-76e0-4929-85b5-50434664acb7\") " pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.777713 master-0 kubenswrapper[4807]: I1014 13:29:23.777517 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" Oct 14 13:29:23.909236 master-0 kubenswrapper[4807]: I1014 13:29:23.909144 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-10-master-0" Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:23.994061 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir\") pod \"eb3f687c-2994-4dc5-8070-f641e02b4341\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:23.994201 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access\") pod \"eb3f687c-2994-4dc5-8070-f641e02b4341\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:23.994232 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock\") pod \"eb3f687c-2994-4dc5-8070-f641e02b4341\" (UID: \"eb3f687c-2994-4dc5-8070-f641e02b4341\") " Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:23.994595 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock" (OuterVolumeSpecName: "var-lock") pod "eb3f687c-2994-4dc5-8070-f641e02b4341" (UID: "eb3f687c-2994-4dc5-8070-f641e02b4341"). InnerVolumeSpecName "var-lock". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:23.994629 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "eb3f687c-2994-4dc5-8070-f641e02b4341" (UID: "eb3f687c-2994-4dc5-8070-f641e02b4341"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:24.006332 master-0 kubenswrapper[4807]: I1014 13:29:24.001063 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "eb3f687c-2994-4dc5-8070-f641e02b4341" (UID: "eb3f687c-2994-4dc5-8070-f641e02b4341"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:29:24.099140 master-0 kubenswrapper[4807]: I1014 13:29:24.099085 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:24.099140 master-0 kubenswrapper[4807]: I1014 13:29:24.099133 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/eb3f687c-2994-4dc5-8070-f641e02b4341-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:24.099140 master-0 kubenswrapper[4807]: I1014 13:29:24.099145 4807 reconciler_common.go:293] "Volume detached for volume \"var-lock\" (UniqueName: \"kubernetes.io/host-path/eb3f687c-2994-4dc5-8070-f641e02b4341-var-lock\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:24.102846 master-0 kubenswrapper[4807]: I1014 13:29:24.102784 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:24.102999 master-0 kubenswrapper[4807]: I1014 13:29:24.102931 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:24.361780 master-0 kubenswrapper[4807]: I1014 13:29:24.361715 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t"] Oct 14 13:29:24.458829 master-0 kubenswrapper[4807]: I1014 13:29:24.458751 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-7d4cc89fcb-mcxbx"] Oct 14 13:29:24.467348 master-0 kubenswrapper[4807]: W1014 13:29:24.467286 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod654a7d43_76e0_4929_85b5_50434664acb7.slice/crio-bd83aae9c6bd0bb3aed85241761da8fe5a7ca0511e0cd1b3724f30879549fd22 WatchSource:0}: Error finding container bd83aae9c6bd0bb3aed85241761da8fe5a7ca0511e0cd1b3724f30879549fd22: Status 404 returned error can't find the container with id bd83aae9c6bd0bb3aed85241761da8fe5a7ca0511e0cd1b3724f30879549fd22 Oct 14 13:29:24.588360 master-0 kubenswrapper[4807]: I1014 13:29:24.588293 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" event={"ID":"62446d23-1f4e-40b6-bb45-129fd33c602b","Type":"ContainerStarted","Data":"dd6c4633990202e6dbcccd2be2bac5207fdf4e1c7196665f1373683974f10826"} Oct 14 13:29:24.589937 master-0 kubenswrapper[4807]: I1014 13:29:24.589879 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" event={"ID":"9e163479-33bf-42a3-9e83-f97d58c5fc56","Type":"ContainerStarted","Data":"92dd1861a598866b5680b39675670ad748419b6e3767d17bdeb6f05da02f4d4b"} Oct 14 13:29:24.591437 master-0 kubenswrapper[4807]: I1014 13:29:24.591402 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" event={"ID":"08bcb56b-d815-4c79-947b-587268bc009f","Type":"ContainerStarted","Data":"3dd833d384625e7d4375075ba1ca5bc4090724885b09cea1266906815afb9c17"} Oct 14 13:29:24.591744 master-0 kubenswrapper[4807]: I1014 13:29:24.591699 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:24.595139 master-0 kubenswrapper[4807]: I1014 13:29:24.595074 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" event={"ID":"9955609a-8b3b-4eb4-a4b2-4bcc4a42ef35","Type":"ContainerStarted","Data":"1f282e50764e9fe0dd0f1b4e05ca92a4f9dd34027b2582cb5161eaf541efb739"} Oct 14 13:29:24.595773 master-0 kubenswrapper[4807]: I1014 13:29:24.595728 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:24.597758 master-0 kubenswrapper[4807]: I1014 13:29:24.597720 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" event={"ID":"654a7d43-76e0-4929-85b5-50434664acb7","Type":"ContainerStarted","Data":"712dccf5b06a81f06dfc83a8eeda99520e9dfa96286b63937b04e97f978e0ef3"} Oct 14 13:29:24.597758 master-0 kubenswrapper[4807]: I1014 13:29:24.597755 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" event={"ID":"654a7d43-76e0-4929-85b5-50434664acb7","Type":"ContainerStarted","Data":"bd83aae9c6bd0bb3aed85241761da8fe5a7ca0511e0cd1b3724f30879549fd22"} Oct 14 13:29:24.601190 master-0 kubenswrapper[4807]: I1014 13:29:24.599996 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" event={"ID":"957d9493-9e2c-491d-a7df-051f69180f41","Type":"ContainerStarted","Data":"b131d4ea7bcc1aea92021c72a00a3c47db213ef5b8d1de09d995ed9ad8da396e"} Oct 14 13:29:24.601190 master-0 kubenswrapper[4807]: I1014 13:29:24.600163 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:24.603694 master-0 kubenswrapper[4807]: I1014 13:29:24.603205 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" event={"ID":"a7585e35-2222-474a-af4c-2acca34586e3","Type":"ContainerStarted","Data":"2da184d05f95798446e8ff85ee02d2afedb5ac7c8541403dbd10d4457913f9c2"} Oct 14 13:29:24.605787 master-0 kubenswrapper[4807]: I1014 13:29:24.605331 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/installer-10-master-0" event={"ID":"eb3f687c-2994-4dc5-8070-f641e02b4341","Type":"ContainerDied","Data":"e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040"} Oct 14 13:29:24.605787 master-0 kubenswrapper[4807]: I1014 13:29:24.605375 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4df37273770e1b51d42ea86d7f25e25362b8ec47105726854c7220bd4ea4040" Oct 14 13:29:24.605787 master-0 kubenswrapper[4807]: I1014 13:29:24.605653 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/installer-10-master-0" Oct 14 13:29:24.608287 master-0 kubenswrapper[4807]: I1014 13:29:24.607849 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" event={"ID":"b04933b1-7908-4c4d-be70-59b27ed5b313","Type":"ContainerStarted","Data":"150e36ea586228e88cd073d7c1f82910b29bfc103cfab2135f4dee7aeacae228"} Oct 14 13:29:24.608287 master-0 kubenswrapper[4807]: I1014 13:29:24.608041 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:24.615691 master-0 kubenswrapper[4807]: I1014 13:29:24.612739 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-admission-webhook-7cb968574c-6c6cd" podStartSLOduration=4.491946906 podStartE2EDuration="8.61271821s" podCreationTimestamp="2025-10-14 13:29:16 +0000 UTC" firstStartedPulling="2025-10-14 13:29:17.039603619 +0000 UTC m=+551.720905443" lastFinishedPulling="2025-10-14 13:29:21.160374923 +0000 UTC m=+555.841676747" observedRunningTime="2025-10-14 13:29:24.611011932 +0000 UTC m=+559.292313756" watchObservedRunningTime="2025-10-14 13:29:24.61271821 +0000 UTC m=+559.294020034" Oct 14 13:29:24.636156 master-0 kubenswrapper[4807]: I1014 13:29:24.636075 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/obo-prometheus-operator-7c8cf85677-w5k2h" podStartSLOduration=1.6426561849999999 podStartE2EDuration="8.636037677s" podCreationTimestamp="2025-10-14 13:29:16 +0000 UTC" firstStartedPulling="2025-10-14 13:29:16.879361626 +0000 UTC m=+551.560663450" lastFinishedPulling="2025-10-14 13:29:23.872743118 +0000 UTC m=+558.554044942" observedRunningTime="2025-10-14 13:29:24.635691897 +0000 UTC m=+559.316993721" watchObservedRunningTime="2025-10-14 13:29:24.636037677 +0000 UTC m=+559.317339501" Oct 14 13:29:24.684706 master-0 kubenswrapper[4807]: I1014 13:29:24.684605 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" podStartSLOduration=2.293311011 podStartE2EDuration="8.684580094s" podCreationTimestamp="2025-10-14 13:29:16 +0000 UTC" firstStartedPulling="2025-10-14 13:29:17.552517046 +0000 UTC m=+552.233818860" lastFinishedPulling="2025-10-14 13:29:23.943786119 +0000 UTC m=+558.625087943" observedRunningTime="2025-10-14 13:29:24.684546913 +0000 UTC m=+559.365848757" watchObservedRunningTime="2025-10-14 13:29:24.684580094 +0000 UTC m=+559.365881918" Oct 14 13:29:24.686561 master-0 kubenswrapper[4807]: I1014 13:29:24.686491 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" Oct 14 13:29:24.755233 master-0 kubenswrapper[4807]: I1014 13:29:24.755120 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-operators/observability-operator-cc5f78dfc-xm62s" podStartSLOduration=2.014444677 podStartE2EDuration="8.75509251s" podCreationTimestamp="2025-10-14 13:29:16 +0000 UTC" firstStartedPulling="2025-10-14 13:29:17.231516475 +0000 UTC m=+551.912818299" lastFinishedPulling="2025-10-14 13:29:23.972164318 +0000 UTC m=+558.653466132" observedRunningTime="2025-10-14 13:29:24.754426451 +0000 UTC m=+559.435728295" watchObservedRunningTime="2025-10-14 13:29:24.75509251 +0000 UTC m=+559.436394344" Oct 14 13:29:24.756259 master-0 kubenswrapper[4807]: I1014 13:29:24.756203 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" podStartSLOduration=2.071399604 podStartE2EDuration="9.756192401s" podCreationTimestamp="2025-10-14 13:29:15 +0000 UTC" firstStartedPulling="2025-10-14 13:29:16.23583553 +0000 UTC m=+550.917137364" lastFinishedPulling="2025-10-14 13:29:23.920628337 +0000 UTC m=+558.601930161" observedRunningTime="2025-10-14 13:29:24.720811454 +0000 UTC m=+559.402113288" watchObservedRunningTime="2025-10-14 13:29:24.756192401 +0000 UTC m=+559.437494235" Oct 14 13:29:24.795731 master-0 kubenswrapper[4807]: I1014 13:29:24.795610 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" podStartSLOduration=2.31654561 podStartE2EDuration="9.7955771s" podCreationTimestamp="2025-10-14 13:29:15 +0000 UTC" firstStartedPulling="2025-10-14 13:29:16.472051224 +0000 UTC m=+551.153353048" lastFinishedPulling="2025-10-14 13:29:23.951082714 +0000 UTC m=+558.632384538" observedRunningTime="2025-10-14 13:29:24.790617681 +0000 UTC m=+559.471919515" watchObservedRunningTime="2025-10-14 13:29:24.7955771 +0000 UTC m=+559.476878924" Oct 14 13:29:24.820124 master-0 kubenswrapper[4807]: I1014 13:29:24.820013 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-7d4cc89fcb-mcxbx" podStartSLOduration=1.819986808 podStartE2EDuration="1.819986808s" podCreationTimestamp="2025-10-14 13:29:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:29:24.818779404 +0000 UTC m=+559.500081228" watchObservedRunningTime="2025-10-14 13:29:24.819986808 +0000 UTC m=+559.501288632" Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: I1014 13:29:26.703913 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:26.704006 master-0 kubenswrapper[4807]: I1014 13:29:26.703994 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:29.104001 master-0 kubenswrapper[4807]: I1014 13:29:29.103791 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:29.104982 master-0 kubenswrapper[4807]: I1014 13:29:29.104041 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: I1014 13:29:31.705662 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:31.705771 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:31.708031 master-0 kubenswrapper[4807]: I1014 13:29:31.705817 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:32.665403 master-0 kubenswrapper[4807]: I1014 13:29:32.665285 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" event={"ID":"9e163479-33bf-42a3-9e83-f97d58c5fc56","Type":"ContainerStarted","Data":"e2a1b601af73f0373a708033e474c85c9e1c5cc059dc39cdb7c1982bcd970d4b"} Oct 14 13:29:32.701135 master-0 kubenswrapper[4807]: I1014 13:29:32.701004 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-operator-858ddd8f98-7gf7t" podStartSLOduration=7.167455714 podStartE2EDuration="14.700975509s" podCreationTimestamp="2025-10-14 13:29:18 +0000 UTC" firstStartedPulling="2025-10-14 13:29:24.403695423 +0000 UTC m=+559.084997247" lastFinishedPulling="2025-10-14 13:29:31.937215228 +0000 UTC m=+566.618517042" observedRunningTime="2025-10-14 13:29:32.698117498 +0000 UTC m=+567.379419372" watchObservedRunningTime="2025-10-14 13:29:32.700975509 +0000 UTC m=+567.382277373" Oct 14 13:29:34.100805 master-0 kubenswrapper[4807]: I1014 13:29:34.100686 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:34.100805 master-0 kubenswrapper[4807]: I1014 13:29:34.100801 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:34.101792 master-0 kubenswrapper[4807]: I1014 13:29:34.100946 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:29:34.102193 master-0 kubenswrapper[4807]: I1014 13:29:34.102106 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:34.102296 master-0 kubenswrapper[4807]: I1014 13:29:34.102233 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:36.041696 master-0 kubenswrapper[4807]: I1014 13:29:36.041586 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-webhook-server-6d98fdfb58-5gp8d" Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: I1014 13:29:36.706410 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:36.706492 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:36.708181 master-0 kubenswrapper[4807]: I1014 13:29:36.707614 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:37.091986 master-0 kubenswrapper[4807]: I1014 13:29:37.091833 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/perses-operator-54bc95c9fb-k5626" Oct 14 13:29:39.100068 master-0 kubenswrapper[4807]: I1014 13:29:39.099930 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:39.100068 master-0 kubenswrapper[4807]: I1014 13:29:39.100021 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: I1014 13:29:41.705738 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:41.705831 master-0 kubenswrapper[4807]: I1014 13:29:41.705825 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:44.100350 master-0 kubenswrapper[4807]: I1014 13:29:44.100279 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:44.100905 master-0 kubenswrapper[4807]: I1014 13:29:44.100385 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: I1014 13:29:46.703351 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:46.703747 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:46.706276 master-0 kubenswrapper[4807]: I1014 13:29:46.705740 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:49.100156 master-0 kubenswrapper[4807]: I1014 13:29:49.100090 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:49.100909 master-0 kubenswrapper[4807]: I1014 13:29:49.100175 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:50.102633 master-0 kubenswrapper[4807]: I1014 13:29:50.102565 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/2.log" Oct 14 13:29:50.103128 master-0 kubenswrapper[4807]: I1014 13:29:50.102953 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:29:50.103514 master-0 kubenswrapper[4807]: I1014 13:29:50.103482 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-rev/0.log" Oct 14 13:29:50.104501 master-0 kubenswrapper[4807]: I1014 13:29:50.104472 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-metrics/0.log" Oct 14 13:29:50.104890 master-0 kubenswrapper[4807]: I1014 13:29:50.104865 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcdctl/0.log" Oct 14 13:29:50.105998 master-0 kubenswrapper[4807]: I1014 13:29:50.105964 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:29:50.112303 master-0 kubenswrapper[4807]: I1014 13:29:50.112250 4807 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-etcd/etcd-master-0" oldPodUID="a7e53a8977ce5fc5588aef94f91dcc24" podUID="14286286be88b59efc7cfc15eca1cc38" Oct 14 13:29:50.168225 master-0 kubenswrapper[4807]: I1014 13:29:50.168135 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168225 master-0 kubenswrapper[4807]: I1014 13:29:50.168205 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168280 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168312 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168339 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir" (OuterVolumeSpecName: "static-pod-dir") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "static-pod-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168401 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168431 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir" (OuterVolumeSpecName: "data-dir") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "data-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.168532 master-0 kubenswrapper[4807]: I1014 13:29:50.168443 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir\") pod \"a7e53a8977ce5fc5588aef94f91dcc24\" (UID: \"a7e53a8977ce5fc5588aef94f91dcc24\") " Oct 14 13:29:50.168732 master-0 kubenswrapper[4807]: I1014 13:29:50.168436 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.168732 master-0 kubenswrapper[4807]: I1014 13:29:50.168480 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin" (OuterVolumeSpecName: "usr-local-bin") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "usr-local-bin". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.168732 master-0 kubenswrapper[4807]: I1014 13:29:50.168504 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.168732 master-0 kubenswrapper[4807]: I1014 13:29:50.168608 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir" (OuterVolumeSpecName: "log-dir") pod "a7e53a8977ce5fc5588aef94f91dcc24" (UID: "a7e53a8977ce5fc5588aef94f91dcc24"). InnerVolumeSpecName "log-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:50.169050 master-0 kubenswrapper[4807]: I1014 13:29:50.169007 4807 reconciler_common.go:293] "Volume detached for volume \"data-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-data-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.169093 master-0 kubenswrapper[4807]: I1014 13:29:50.169048 4807 reconciler_common.go:293] "Volume detached for volume \"usr-local-bin\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-usr-local-bin\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.169093 master-0 kubenswrapper[4807]: I1014 13:29:50.169070 4807 reconciler_common.go:293] "Volume detached for volume \"log-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-log-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.169093 master-0 kubenswrapper[4807]: I1014 13:29:50.169087 4807 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-resource-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.169194 master-0 kubenswrapper[4807]: I1014 13:29:50.169104 4807 reconciler_common.go:293] "Volume detached for volume \"static-pod-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-static-pod-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.169194 master-0 kubenswrapper[4807]: I1014 13:29:50.169125 4807 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/a7e53a8977ce5fc5588aef94f91dcc24-cert-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:50.272361 master-0 kubenswrapper[4807]: I1014 13:29:50.272180 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7e53a8977ce5fc5588aef94f91dcc24" path="/var/lib/kubelet/pods/a7e53a8977ce5fc5588aef94f91dcc24/volumes" Oct 14 13:29:50.775886 master-0 kubenswrapper[4807]: I1014 13:29:50.775803 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/2.log" Oct 14 13:29:50.776365 master-0 kubenswrapper[4807]: I1014 13:29:50.776344 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd/1.log" Oct 14 13:29:50.776982 master-0 kubenswrapper[4807]: I1014 13:29:50.776940 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-rev/0.log" Oct 14 13:29:50.778409 master-0 kubenswrapper[4807]: I1014 13:29:50.778348 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcd-metrics/0.log" Oct 14 13:29:50.779084 master-0 kubenswrapper[4807]: I1014 13:29:50.779039 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_a7e53a8977ce5fc5588aef94f91dcc24/etcdctl/0.log" Oct 14 13:29:50.780560 master-0 kubenswrapper[4807]: I1014 13:29:50.780502 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" exitCode=137 Oct 14 13:29:50.780560 master-0 kubenswrapper[4807]: I1014 13:29:50.780550 4807 generic.go:334] "Generic (PLEG): container finished" podID="a7e53a8977ce5fc5588aef94f91dcc24" containerID="052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" exitCode=137 Oct 14 13:29:50.780668 master-0 kubenswrapper[4807]: I1014 13:29:50.780645 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:29:50.780707 master-0 kubenswrapper[4807]: I1014 13:29:50.780668 4807 scope.go:117] "RemoveContainer" containerID="876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" Oct 14 13:29:50.788046 master-0 kubenswrapper[4807]: I1014 13:29:50.787977 4807 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-etcd/etcd-master-0" oldPodUID="a7e53a8977ce5fc5588aef94f91dcc24" podUID="14286286be88b59efc7cfc15eca1cc38" Oct 14 13:29:50.806781 master-0 kubenswrapper[4807]: I1014 13:29:50.806725 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:29:50.837308 master-0 kubenswrapper[4807]: I1014 13:29:50.837179 4807 scope.go:117] "RemoveContainer" containerID="c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" Oct 14 13:29:50.857860 master-0 kubenswrapper[4807]: I1014 13:29:50.857807 4807 scope.go:117] "RemoveContainer" containerID="ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" Oct 14 13:29:50.889956 master-0 kubenswrapper[4807]: I1014 13:29:50.889870 4807 scope.go:117] "RemoveContainer" containerID="7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" Oct 14 13:29:50.911596 master-0 kubenswrapper[4807]: I1014 13:29:50.911542 4807 scope.go:117] "RemoveContainer" containerID="052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" Oct 14 13:29:50.930939 master-0 kubenswrapper[4807]: I1014 13:29:50.930690 4807 scope.go:117] "RemoveContainer" containerID="1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76" Oct 14 13:29:50.960008 master-0 kubenswrapper[4807]: I1014 13:29:50.959920 4807 scope.go:117] "RemoveContainer" containerID="ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1" Oct 14 13:29:50.987898 master-0 kubenswrapper[4807]: I1014 13:29:50.987823 4807 scope.go:117] "RemoveContainer" containerID="7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413" Oct 14 13:29:51.012074 master-0 kubenswrapper[4807]: I1014 13:29:51.012005 4807 scope.go:117] "RemoveContainer" containerID="876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" Oct 14 13:29:51.012745 master-0 kubenswrapper[4807]: E1014 13:29:51.012674 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c\": container with ID starting with 876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c not found: ID does not exist" containerID="876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" Oct 14 13:29:51.012866 master-0 kubenswrapper[4807]: I1014 13:29:51.012756 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c"} err="failed to get container status \"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c\": rpc error: code = NotFound desc = could not find container \"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c\": container with ID starting with 876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c not found: ID does not exist" Oct 14 13:29:51.012866 master-0 kubenswrapper[4807]: I1014 13:29:51.012811 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:29:51.013641 master-0 kubenswrapper[4807]: E1014 13:29:51.013514 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776\": container with ID starting with 267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776 not found: ID does not exist" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:29:51.013776 master-0 kubenswrapper[4807]: I1014 13:29:51.013650 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776"} err="failed to get container status \"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776\": rpc error: code = NotFound desc = could not find container \"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776\": container with ID starting with 267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776 not found: ID does not exist" Oct 14 13:29:51.013776 master-0 kubenswrapper[4807]: I1014 13:29:51.013698 4807 scope.go:117] "RemoveContainer" containerID="c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" Oct 14 13:29:51.014334 master-0 kubenswrapper[4807]: E1014 13:29:51.014262 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1\": container with ID starting with c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1 not found: ID does not exist" containerID="c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" Oct 14 13:29:51.014428 master-0 kubenswrapper[4807]: I1014 13:29:51.014341 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1"} err="failed to get container status \"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1\": rpc error: code = NotFound desc = could not find container \"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1\": container with ID starting with c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1 not found: ID does not exist" Oct 14 13:29:51.014428 master-0 kubenswrapper[4807]: I1014 13:29:51.014382 4807 scope.go:117] "RemoveContainer" containerID="ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" Oct 14 13:29:51.014993 master-0 kubenswrapper[4807]: E1014 13:29:51.014941 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a\": container with ID starting with ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a not found: ID does not exist" containerID="ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" Oct 14 13:29:51.014993 master-0 kubenswrapper[4807]: I1014 13:29:51.014968 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a"} err="failed to get container status \"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a\": rpc error: code = NotFound desc = could not find container \"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a\": container with ID starting with ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a not found: ID does not exist" Oct 14 13:29:51.014993 master-0 kubenswrapper[4807]: I1014 13:29:51.014985 4807 scope.go:117] "RemoveContainer" containerID="7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" Oct 14 13:29:51.015451 master-0 kubenswrapper[4807]: E1014 13:29:51.015384 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff\": container with ID starting with 7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff not found: ID does not exist" containerID="7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" Oct 14 13:29:51.015593 master-0 kubenswrapper[4807]: I1014 13:29:51.015442 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff"} err="failed to get container status \"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff\": rpc error: code = NotFound desc = could not find container \"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff\": container with ID starting with 7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff not found: ID does not exist" Oct 14 13:29:51.015593 master-0 kubenswrapper[4807]: I1014 13:29:51.015509 4807 scope.go:117] "RemoveContainer" containerID="052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" Oct 14 13:29:51.016103 master-0 kubenswrapper[4807]: E1014 13:29:51.016046 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3\": container with ID starting with 052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3 not found: ID does not exist" containerID="052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" Oct 14 13:29:51.016103 master-0 kubenswrapper[4807]: I1014 13:29:51.016077 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3"} err="failed to get container status \"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3\": rpc error: code = NotFound desc = could not find container \"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3\": container with ID starting with 052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3 not found: ID does not exist" Oct 14 13:29:51.016103 master-0 kubenswrapper[4807]: I1014 13:29:51.016096 4807 scope.go:117] "RemoveContainer" containerID="1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76" Oct 14 13:29:51.016549 master-0 kubenswrapper[4807]: E1014 13:29:51.016449 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76\": container with ID starting with 1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76 not found: ID does not exist" containerID="1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76" Oct 14 13:29:51.016655 master-0 kubenswrapper[4807]: I1014 13:29:51.016543 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76"} err="failed to get container status \"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76\": rpc error: code = NotFound desc = could not find container \"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76\": container with ID starting with 1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76 not found: ID does not exist" Oct 14 13:29:51.016655 master-0 kubenswrapper[4807]: I1014 13:29:51.016581 4807 scope.go:117] "RemoveContainer" containerID="ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1" Oct 14 13:29:51.017064 master-0 kubenswrapper[4807]: E1014 13:29:51.017012 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1\": container with ID starting with ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1 not found: ID does not exist" containerID="ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1" Oct 14 13:29:51.017147 master-0 kubenswrapper[4807]: I1014 13:29:51.017058 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1"} err="failed to get container status \"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1\": rpc error: code = NotFound desc = could not find container \"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1\": container with ID starting with ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1 not found: ID does not exist" Oct 14 13:29:51.017147 master-0 kubenswrapper[4807]: I1014 13:29:51.017093 4807 scope.go:117] "RemoveContainer" containerID="7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413" Oct 14 13:29:51.017582 master-0 kubenswrapper[4807]: E1014 13:29:51.017519 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413\": container with ID starting with 7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413 not found: ID does not exist" containerID="7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413" Oct 14 13:29:51.017708 master-0 kubenswrapper[4807]: I1014 13:29:51.017581 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413"} err="failed to get container status \"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413\": rpc error: code = NotFound desc = could not find container \"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413\": container with ID starting with 7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413 not found: ID does not exist" Oct 14 13:29:51.017708 master-0 kubenswrapper[4807]: I1014 13:29:51.017652 4807 scope.go:117] "RemoveContainer" containerID="876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c" Oct 14 13:29:51.018796 master-0 kubenswrapper[4807]: I1014 13:29:51.018727 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c"} err="failed to get container status \"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c\": rpc error: code = NotFound desc = could not find container \"876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c\": container with ID starting with 876595979a679009fc439b49279c098873e3e0cbe3d1698aaad2174c11faa35c not found: ID does not exist" Oct 14 13:29:51.018796 master-0 kubenswrapper[4807]: I1014 13:29:51.018777 4807 scope.go:117] "RemoveContainer" containerID="267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776" Oct 14 13:29:51.019179 master-0 kubenswrapper[4807]: I1014 13:29:51.019114 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776"} err="failed to get container status \"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776\": rpc error: code = NotFound desc = could not find container \"267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776\": container with ID starting with 267d8a2784b3ec2a46f37265941d706a050181747cc7eb0dc7692ce980189776 not found: ID does not exist" Oct 14 13:29:51.019179 master-0 kubenswrapper[4807]: I1014 13:29:51.019163 4807 scope.go:117] "RemoveContainer" containerID="c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1" Oct 14 13:29:51.019556 master-0 kubenswrapper[4807]: I1014 13:29:51.019505 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1"} err="failed to get container status \"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1\": rpc error: code = NotFound desc = could not find container \"c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1\": container with ID starting with c28093c2a887f5dc2cc177150ce50ca0a090f2c5da3af292159846a681a63bb1 not found: ID does not exist" Oct 14 13:29:51.019556 master-0 kubenswrapper[4807]: I1014 13:29:51.019533 4807 scope.go:117] "RemoveContainer" containerID="ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a" Oct 14 13:29:51.019841 master-0 kubenswrapper[4807]: I1014 13:29:51.019789 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a"} err="failed to get container status \"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a\": rpc error: code = NotFound desc = could not find container \"ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a\": container with ID starting with ce75e3f4bef13cba1ba8032e902fa928b03b6e27b1e83928f77b1c9bdfe6531a not found: ID does not exist" Oct 14 13:29:51.019841 master-0 kubenswrapper[4807]: I1014 13:29:51.019818 4807 scope.go:117] "RemoveContainer" containerID="7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff" Oct 14 13:29:51.020214 master-0 kubenswrapper[4807]: I1014 13:29:51.020129 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff"} err="failed to get container status \"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff\": rpc error: code = NotFound desc = could not find container \"7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff\": container with ID starting with 7aba54bb5eb4c87a56ce8dbeb166abd946fc026bc08c7bef2dc7fc3fcc2395ff not found: ID does not exist" Oct 14 13:29:51.020214 master-0 kubenswrapper[4807]: I1014 13:29:51.020170 4807 scope.go:117] "RemoveContainer" containerID="052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3" Oct 14 13:29:51.020733 master-0 kubenswrapper[4807]: I1014 13:29:51.020570 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3"} err="failed to get container status \"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3\": rpc error: code = NotFound desc = could not find container \"052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3\": container with ID starting with 052b29a80030abb9f42e199b504aea3c860f7d93f4280d5f8594b10eb0642ec3 not found: ID does not exist" Oct 14 13:29:51.020733 master-0 kubenswrapper[4807]: I1014 13:29:51.020602 4807 scope.go:117] "RemoveContainer" containerID="1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76" Oct 14 13:29:51.021055 master-0 kubenswrapper[4807]: I1014 13:29:51.021017 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76"} err="failed to get container status \"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76\": rpc error: code = NotFound desc = could not find container \"1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76\": container with ID starting with 1226aa4588e9f5370b81d1f504659186b8f4a211fd7b9979040ded9552963b76 not found: ID does not exist" Oct 14 13:29:51.021055 master-0 kubenswrapper[4807]: I1014 13:29:51.021046 4807 scope.go:117] "RemoveContainer" containerID="ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1" Oct 14 13:29:51.021374 master-0 kubenswrapper[4807]: I1014 13:29:51.021323 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1"} err="failed to get container status \"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1\": rpc error: code = NotFound desc = could not find container \"ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1\": container with ID starting with ec2ca0d96ae10acc7f187ad307e3fbb56e5a674268fce62740ce91a837341ca1 not found: ID does not exist" Oct 14 13:29:51.021374 master-0 kubenswrapper[4807]: I1014 13:29:51.021350 4807 scope.go:117] "RemoveContainer" containerID="7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413" Oct 14 13:29:51.021796 master-0 kubenswrapper[4807]: I1014 13:29:51.021731 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413"} err="failed to get container status \"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413\": rpc error: code = NotFound desc = could not find container \"7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413\": container with ID starting with 7f6f057aa3d1be636033ae4ed5348d9d576bfc0e861d9e9e6a7f20a5a7e09413 not found: ID does not exist" Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: I1014 13:29:51.705708 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 500" start-of-body=[+]ping ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]log ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]api-openshift-apiserver-available ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]api-openshift-oauth-apiserver-available ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]informer-sync ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-openshift-apiserver-reachable ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-oauth-apiserver-reachable ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiserver-admission-initializer ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/quota.openshift.io-clusterquotamapping ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-api-request-count-filter ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/openshift.io-startkubeinformers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/generic-apiserver-start-informers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-consumer ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-filter ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/storage-object-count-tracker-hook ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-informers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-apiextensions-controllers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/crd-informer-synced ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-system-namespaces-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-cluster-authentication-info-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-apiserver-identity-lease-garbage-collector ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-legacy-token-tracking-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-service-ip-repair-controllers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/rbac/bootstrap-roles ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/scheduling/bootstrap-system-priority-classes ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/priority-and-fairness-config-producer ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/bootstrap-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/aggregator-reload-proxy-client-cert ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/start-kube-aggregator-informers ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-local-available-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-status-remote-available-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-registration-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-wait-for-first-sync ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-discovery-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/kube-apiserver-autoregistration ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]autoregister-completion ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapi-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [+]poststarthook/apiservice-openapiv3-controller ok Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: [-]shutdown failed: reason withheld Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: readyz check failed Oct 14 13:29:51.705775 master-0 kubenswrapper[4807]: I1014 13:29:51.705779 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 500" Oct 14 13:29:54.100879 master-0 kubenswrapper[4807]: I1014 13:29:54.100739 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" start-of-body= Oct 14 13:29:54.102000 master-0 kubenswrapper[4807]: I1014 13:29:54.100870 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": dial tcp 192.168.34.10:9980: connect: connection refused" Oct 14 13:29:54.262021 master-0 kubenswrapper[4807]: I1014 13:29:54.261913 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:29:54.284638 master-0 kubenswrapper[4807]: I1014 13:29:54.284566 4807 kubelet.go:1909] "Trying to delete pod" pod="openshift-etcd/etcd-master-0" podUID="bf632afd-0987-4cd8-81d4-2ff5fce35107" Oct 14 13:29:54.284638 master-0 kubenswrapper[4807]: I1014 13:29:54.284629 4807 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-etcd/etcd-master-0" podUID="bf632afd-0987-4cd8-81d4-2ff5fce35107" Oct 14 13:29:54.310338 master-0 kubenswrapper[4807]: I1014 13:29:54.308560 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:29:54.316497 master-0 kubenswrapper[4807]: I1014 13:29:54.314705 4807 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-etcd/etcd-master-0" Oct 14 13:29:54.324660 master-0 kubenswrapper[4807]: I1014 13:29:54.324579 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:29:54.354111 master-0 kubenswrapper[4807]: I1014 13:29:54.353856 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-etcd/etcd-master-0"] Oct 14 13:29:54.354951 master-0 kubenswrapper[4807]: I1014 13:29:54.354832 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-etcd/etcd-master-0" Oct 14 13:29:54.811615 master-0 kubenswrapper[4807]: I1014 13:29:54.811541 4807 generic.go:334] "Generic (PLEG): container finished" podID="14286286be88b59efc7cfc15eca1cc38" containerID="da81ef09f5961003895332140efb1b6d572e231b3b513187398eff0b2433b1d6" exitCode=0 Oct 14 13:29:54.811615 master-0 kubenswrapper[4807]: I1014 13:29:54.811602 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerDied","Data":"da81ef09f5961003895332140efb1b6d572e231b3b513187398eff0b2433b1d6"} Oct 14 13:29:54.811980 master-0 kubenswrapper[4807]: I1014 13:29:54.811641 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"fa704ccfa57807d6b430f8ecec1c0769fc93a88e12ea8aa7071dd55d4c33f7f8"} Oct 14 13:29:55.772112 master-0 kubenswrapper[4807]: I1014 13:29:55.772015 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/metallb-operator-controller-manager-6479dd8558-s545w" Oct 14 13:29:55.824623 master-0 kubenswrapper[4807]: I1014 13:29:55.824548 4807 generic.go:334] "Generic (PLEG): container finished" podID="14286286be88b59efc7cfc15eca1cc38" containerID="593711f24b56a31ca6905970eac1a468238f16f8f645b8aa8de75dd695c20540" exitCode=0 Oct 14 13:29:55.824623 master-0 kubenswrapper[4807]: I1014 13:29:55.824617 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerDied","Data":"593711f24b56a31ca6905970eac1a468238f16f8f645b8aa8de75dd695c20540"} Oct 14 13:29:56.699233 master-0 kubenswrapper[4807]: I1014 13:29:56.699134 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" start-of-body= Oct 14 13:29:56.699233 master-0 kubenswrapper[4807]: I1014 13:29:56.699201 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" Oct 14 13:29:56.837034 master-0 kubenswrapper[4807]: I1014 13:29:56.836931 4807 generic.go:334] "Generic (PLEG): container finished" podID="14286286be88b59efc7cfc15eca1cc38" containerID="fd520881cae8694547af087036e57998971df1f3160daec0fb2cd038d758e1aa" exitCode=0 Oct 14 13:29:56.838034 master-0 kubenswrapper[4807]: I1014 13:29:56.837009 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerDied","Data":"fd520881cae8694547af087036e57998971df1f3160daec0fb2cd038d758e1aa"} Oct 14 13:29:57.853488 master-0 kubenswrapper[4807]: I1014 13:29:57.853392 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"ed305bdc363800dc92144cb510437a0b861c856b21bc35e037a1cb580bed8278"} Oct 14 13:29:57.854454 master-0 kubenswrapper[4807]: I1014 13:29:57.853491 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"09ed194b1e5717629bede86864896ec6bb005cffffe12bc2879bebacdb57e698"} Oct 14 13:29:57.859154 master-0 kubenswrapper[4807]: I1014 13:29:57.859076 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_40c30bb582d8e7e3bec33943f1330ffc/kube-apiserver-cert-syncer/0.log" Oct 14 13:29:57.861258 master-0 kubenswrapper[4807]: I1014 13:29:57.861214 4807 generic.go:334] "Generic (PLEG): container finished" podID="40c30bb582d8e7e3bec33943f1330ffc" containerID="dec5918ebbe7cb191e8c2bdaa2d0bd65a9239fcf84d289def1bc5626181876f2" exitCode=0 Oct 14 13:29:58.005606 master-0 kubenswrapper[4807]: I1014 13:29:58.005544 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_40c30bb582d8e7e3bec33943f1330ffc/kube-apiserver-cert-syncer/0.log" Oct 14 13:29:58.006716 master-0 kubenswrapper[4807]: I1014 13:29:58.006672 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:29:58.012296 master-0 kubenswrapper[4807]: I1014 13:29:58.012246 4807 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="40c30bb582d8e7e3bec33943f1330ffc" podUID="08bb0ac7b01a53ae0dcb90ce8b66efa1" Oct 14 13:29:58.075840 master-0 kubenswrapper[4807]: I1014 13:29:58.075781 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir\") pod \"40c30bb582d8e7e3bec33943f1330ffc\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " Oct 14 13:29:58.076085 master-0 kubenswrapper[4807]: I1014 13:29:58.075867 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir\") pod \"40c30bb582d8e7e3bec33943f1330ffc\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " Oct 14 13:29:58.076085 master-0 kubenswrapper[4807]: I1014 13:29:58.076000 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir\") pod \"40c30bb582d8e7e3bec33943f1330ffc\" (UID: \"40c30bb582d8e7e3bec33943f1330ffc\") " Oct 14 13:29:58.076268 master-0 kubenswrapper[4807]: I1014 13:29:58.076159 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir" (OuterVolumeSpecName: "cert-dir") pod "40c30bb582d8e7e3bec33943f1330ffc" (UID: "40c30bb582d8e7e3bec33943f1330ffc"). InnerVolumeSpecName "cert-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:58.076268 master-0 kubenswrapper[4807]: I1014 13:29:58.076172 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir" (OuterVolumeSpecName: "resource-dir") pod "40c30bb582d8e7e3bec33943f1330ffc" (UID: "40c30bb582d8e7e3bec33943f1330ffc"). InnerVolumeSpecName "resource-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:58.076268 master-0 kubenswrapper[4807]: I1014 13:29:58.076236 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir" (OuterVolumeSpecName: "audit-dir") pod "40c30bb582d8e7e3bec33943f1330ffc" (UID: "40c30bb582d8e7e3bec33943f1330ffc"). InnerVolumeSpecName "audit-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:29:58.177054 master-0 kubenswrapper[4807]: I1014 13:29:58.176959 4807 reconciler_common.go:293] "Volume detached for volume \"resource-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-resource-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:58.177054 master-0 kubenswrapper[4807]: I1014 13:29:58.177036 4807 reconciler_common.go:293] "Volume detached for volume \"audit-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-audit-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:58.177054 master-0 kubenswrapper[4807]: I1014 13:29:58.177063 4807 reconciler_common.go:293] "Volume detached for volume \"cert-dir\" (UniqueName: \"kubernetes.io/host-path/40c30bb582d8e7e3bec33943f1330ffc-cert-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:29:58.263935 master-0 kubenswrapper[4807]: I1014 13:29:58.263771 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" start-of-body= Oct 14 13:29:58.263935 master-0 kubenswrapper[4807]: I1014 13:29:58.263858 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" Oct 14 13:29:58.272717 master-0 kubenswrapper[4807]: I1014 13:29:58.272658 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40c30bb582d8e7e3bec33943f1330ffc" path="/var/lib/kubelet/pods/40c30bb582d8e7e3bec33943f1330ffc/volumes" Oct 14 13:29:58.874666 master-0 kubenswrapper[4807]: I1014 13:29:58.874595 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"e0dc841e79871b4a9dd76ca8f07e1140de0fefdb9591f77459625909ae06a303"} Oct 14 13:29:58.874666 master-0 kubenswrapper[4807]: I1014 13:29:58.874674 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"64c54d34e05e51faeb3497a8141f6029ef9d5a2b354e54233658d216d3ed1938"} Oct 14 13:29:58.875422 master-0 kubenswrapper[4807]: I1014 13:29:58.874697 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-etcd/etcd-master-0" event={"ID":"14286286be88b59efc7cfc15eca1cc38","Type":"ContainerStarted","Data":"7a78375db34afe3764dbfb5d9e96fcac89c7aa615451c7cadfb5b78b1ba5b0aa"} Oct 14 13:29:58.878675 master-0 kubenswrapper[4807]: I1014 13:29:58.878601 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-apiserver_kube-apiserver-master-0_40c30bb582d8e7e3bec33943f1330ffc/kube-apiserver-cert-syncer/0.log" Oct 14 13:29:58.880006 master-0 kubenswrapper[4807]: I1014 13:29:58.879947 4807 scope.go:117] "RemoveContainer" containerID="3ab81a7a646d8f6d5bcae00d5538afa1e6a01ee30e055c4fe670b2c146c7720b" Oct 14 13:29:58.880083 master-0 kubenswrapper[4807]: I1014 13:29:58.880055 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:29:58.897696 master-0 kubenswrapper[4807]: I1014 13:29:58.897155 4807 scope.go:117] "RemoveContainer" containerID="5c5daacfb0225fe961091c33b1dc83dfd171d82a17eb297f5b8ce555bc2aa238" Oct 14 13:29:58.911226 master-0 kubenswrapper[4807]: I1014 13:29:58.911174 4807 scope.go:117] "RemoveContainer" containerID="c3cf45ef34f25e08c26b027a0766915776abd26c9522b9ac0f232df64f0e6c43" Oct 14 13:29:58.929712 master-0 kubenswrapper[4807]: I1014 13:29:58.927160 4807 scope.go:117] "RemoveContainer" containerID="0e684b866a40c803a4fd7b32d2dd43092436b26316f3af5795b50321d753ebef" Oct 14 13:29:58.929712 master-0 kubenswrapper[4807]: I1014 13:29:58.929136 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-etcd/etcd-master-0" podStartSLOduration=4.928419763 podStartE2EDuration="4.928419763s" podCreationTimestamp="2025-10-14 13:29:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:29:58.921853668 +0000 UTC m=+593.603155512" watchObservedRunningTime="2025-10-14 13:29:58.928419763 +0000 UTC m=+593.609721607" Oct 14 13:29:58.934286 master-0 kubenswrapper[4807]: I1014 13:29:58.934228 4807 status_manager.go:861] "Pod was deleted and then recreated, skipping status update" pod="openshift-kube-apiserver/kube-apiserver-master-0" oldPodUID="40c30bb582d8e7e3bec33943f1330ffc" podUID="08bb0ac7b01a53ae0dcb90ce8b66efa1" Oct 14 13:29:58.943095 master-0 kubenswrapper[4807]: I1014 13:29:58.943049 4807 scope.go:117] "RemoveContainer" containerID="dec5918ebbe7cb191e8c2bdaa2d0bd65a9239fcf84d289def1bc5626181876f2" Oct 14 13:29:58.959521 master-0 kubenswrapper[4807]: I1014 13:29:58.959470 4807 scope.go:117] "RemoveContainer" containerID="57b5a24338447921547b613cda6aded66e5aa0ab5987b7f31574b05721913c72" Oct 14 13:29:59.356233 master-0 kubenswrapper[4807]: I1014 13:29:59.356132 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-etcd/etcd-master-0" Oct 14 13:30:01.699868 master-0 kubenswrapper[4807]: I1014 13:30:01.699764 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" start-of-body= Oct 14 13:30:01.699868 master-0 kubenswrapper[4807]: I1014 13:30:01.699848 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:6443/readyz\": dial tcp 192.168.34.10:6443: connect: connection refused" Oct 14 13:30:03.583966 master-0 kubenswrapper[4807]: I1014 13:30:03.583878 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c"] Oct 14 13:30:03.585426 master-0 kubenswrapper[4807]: E1014 13:30:03.584302 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eb3f687c-2994-4dc5-8070-f641e02b4341" containerName="installer" Oct 14 13:30:03.585426 master-0 kubenswrapper[4807]: I1014 13:30:03.584325 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb3f687c-2994-4dc5-8070-f641e02b4341" containerName="installer" Oct 14 13:30:03.585426 master-0 kubenswrapper[4807]: I1014 13:30:03.584617 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="eb3f687c-2994-4dc5-8070-f641e02b4341" containerName="installer" Oct 14 13:30:03.587502 master-0 kubenswrapper[4807]: I1014 13:30:03.587197 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.590633 master-0 kubenswrapper[4807]: I1014 13:30:03.590577 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-webhook-server-cert" Oct 14 13:30:03.607534 master-0 kubenswrapper[4807]: I1014 13:30:03.607397 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c"] Oct 14 13:30:03.612671 master-0 kubenswrapper[4807]: I1014 13:30:03.612614 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/frr-k8s-qqrwm"] Oct 14 13:30:03.617513 master-0 kubenswrapper[4807]: I1014 13:30:03.617445 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.620606 master-0 kubenswrapper[4807]: I1014 13:30:03.620547 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-certs-secret" Oct 14 13:30:03.621427 master-0 kubenswrapper[4807]: I1014 13:30:03.621368 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"frr-startup" Oct 14 13:30:03.735449 master-0 kubenswrapper[4807]: I1014 13:30:03.735337 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/speaker-hfvls"] Oct 14 13:30:03.736851 master-0 kubenswrapper[4807]: I1014 13:30:03.736802 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.739944 master-0 kubenswrapper[4807]: I1014 13:30:03.739867 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-certs-secret" Oct 14 13:30:03.740084 master-0 kubenswrapper[4807]: I1014 13:30:03.740038 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-memberlist" Oct 14 13:30:03.740217 master-0 kubenswrapper[4807]: I1014 13:30:03.739870 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"metallb-system"/"metallb-excludel2" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758136 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-conf\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758225 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-reloader\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758274 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j886s\" (UniqueName: \"kubernetes.io/projected/aabbab44-056d-4d23-a56c-877219e1a31f-kube-api-access-j886s\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758483 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758530 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lxzp\" (UniqueName: \"kubernetes.io/projected/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-kube-api-access-9lxzp\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758574 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-startup\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758604 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics-certs\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758724 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758757 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/aabbab44-056d-4d23-a56c-877219e1a31f-metallb-excludel2\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758792 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkn5s\" (UniqueName: \"kubernetes.io/projected/6c5ab050-caa4-4372-871f-45bc7f28ad18-kube-api-access-mkn5s\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758832 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-sockets\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.758879 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5ab050-caa4-4372-871f-45bc7f28ad18-cert\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.759488 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.760703 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["metallb-system/controller-68d546b9d8-9strj"] Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.762200 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.765632 master-0 kubenswrapper[4807]: I1014 13:30:03.764320 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-certs-secret" Oct 14 13:30:03.785829 master-0 kubenswrapper[4807]: I1014 13:30:03.785658 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-68d546b9d8-9strj"] Oct 14 13:30:03.861372 master-0 kubenswrapper[4807]: I1014 13:30:03.861261 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/aabbab44-056d-4d23-a56c-877219e1a31f-metallb-excludel2\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.861372 master-0 kubenswrapper[4807]: I1014 13:30:03.861329 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.861372 master-0 kubenswrapper[4807]: I1014 13:30:03.861360 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mkn5s\" (UniqueName: \"kubernetes.io/projected/6c5ab050-caa4-4372-871f-45bc7f28ad18-kube-api-access-mkn5s\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861390 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-sockets\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861419 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5ab050-caa4-4372-871f-45bc7f28ad18-cert\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861448 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861506 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-conf\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861529 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-reloader\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861550 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j886s\" (UniqueName: \"kubernetes.io/projected/aabbab44-056d-4d23-a56c-877219e1a31f-kube-api-access-j886s\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861587 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-metrics-certs\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861615 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-525d7\" (UniqueName: \"kubernetes.io/projected/f78dc348-fb2b-469f-8401-e2f66a301e22-kube-api-access-525d7\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861652 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861677 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9lxzp\" (UniqueName: \"kubernetes.io/projected/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-kube-api-access-9lxzp\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861701 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-cert\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861727 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-startup\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.862038 master-0 kubenswrapper[4807]: I1014 13:30:03.861748 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics-certs\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: I1014 13:30:03.862209 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: I1014 13:30:03.862271 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metallb-excludel2\" (UniqueName: \"kubernetes.io/configmap/aabbab44-056d-4d23-a56c-877219e1a31f-metallb-excludel2\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: E1014 13:30:03.862455 4807 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: E1014 13:30:03.862579 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist podName:aabbab44-056d-4d23-a56c-877219e1a31f nodeName:}" failed. No retries permitted until 2025-10-14 13:30:04.362545016 +0000 UTC m=+599.043846880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist") pod "speaker-hfvls" (UID: "aabbab44-056d-4d23-a56c-877219e1a31f") : secret "metallb-memberlist" not found Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: E1014 13:30:03.862455 4807 secret.go:189] Couldn't get secret metallb-system/speaker-certs-secret: secret "speaker-certs-secret" not found Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: E1014 13:30:03.862895 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs podName:aabbab44-056d-4d23-a56c-877219e1a31f nodeName:}" failed. No retries permitted until 2025-10-14 13:30:04.362867825 +0000 UTC m=+599.044169649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs") pod "speaker-hfvls" (UID: "aabbab44-056d-4d23-a56c-877219e1a31f") : secret "speaker-certs-secret" not found Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: I1014 13:30:03.863175 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"reloader\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-reloader\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.863355 master-0 kubenswrapper[4807]: I1014 13:30:03.863219 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-conf\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-conf\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.863941 master-0 kubenswrapper[4807]: I1014 13:30:03.863431 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-sockets\" (UniqueName: \"kubernetes.io/empty-dir/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-sockets\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.863941 master-0 kubenswrapper[4807]: I1014 13:30:03.863700 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"frr-startup\" (UniqueName: \"kubernetes.io/configmap/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-frr-startup\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.865752 master-0 kubenswrapper[4807]: I1014 13:30:03.865683 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6c5ab050-caa4-4372-871f-45bc7f28ad18-cert\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.866525 master-0 kubenswrapper[4807]: I1014 13:30:03.866390 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-metrics-certs\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.885364 master-0 kubenswrapper[4807]: I1014 13:30:03.885254 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j886s\" (UniqueName: \"kubernetes.io/projected/aabbab44-056d-4d23-a56c-877219e1a31f-kube-api-access-j886s\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:03.889925 master-0 kubenswrapper[4807]: I1014 13:30:03.889872 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lxzp\" (UniqueName: \"kubernetes.io/projected/37d82bf0-fc72-4e94-9f3b-73cd32e876ad-kube-api-access-9lxzp\") pod \"frr-k8s-qqrwm\" (UID: \"37d82bf0-fc72-4e94-9f3b-73cd32e876ad\") " pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.894113 master-0 kubenswrapper[4807]: I1014 13:30:03.893766 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkn5s\" (UniqueName: \"kubernetes.io/projected/6c5ab050-caa4-4372-871f-45bc7f28ad18-kube-api-access-mkn5s\") pod \"frr-k8s-webhook-server-64bf5d555-sgx9c\" (UID: \"6c5ab050-caa4-4372-871f-45bc7f28ad18\") " pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.910317 master-0 kubenswrapper[4807]: I1014 13:30:03.910155 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:03.939438 master-0 kubenswrapper[4807]: I1014 13:30:03.939372 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:03.963508 master-0 kubenswrapper[4807]: I1014 13:30:03.963385 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-metrics-certs\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.963508 master-0 kubenswrapper[4807]: I1014 13:30:03.963479 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-525d7\" (UniqueName: \"kubernetes.io/projected/f78dc348-fb2b-469f-8401-e2f66a301e22-kube-api-access-525d7\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.963813 master-0 kubenswrapper[4807]: I1014 13:30:03.963552 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-cert\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.969865 master-0 kubenswrapper[4807]: I1014 13:30:03.969785 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-cert\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.970120 master-0 kubenswrapper[4807]: I1014 13:30:03.970040 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f78dc348-fb2b-469f-8401-e2f66a301e22-metrics-certs\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:03.994676 master-0 kubenswrapper[4807]: I1014 13:30:03.984307 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-525d7\" (UniqueName: \"kubernetes.io/projected/f78dc348-fb2b-469f-8401-e2f66a301e22-kube-api-access-525d7\") pod \"controller-68d546b9d8-9strj\" (UID: \"f78dc348-fb2b-469f-8401-e2f66a301e22\") " pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:04.081782 master-0 kubenswrapper[4807]: I1014 13:30:04.081700 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:04.100125 master-0 kubenswrapper[4807]: I1014 13:30:04.100062 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:04.100326 master-0 kubenswrapper[4807]: I1014 13:30:04.100147 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:04.341719 master-0 kubenswrapper[4807]: I1014 13:30:04.341626 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c"] Oct 14 13:30:04.350023 master-0 kubenswrapper[4807]: W1014 13:30:04.349948 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6c5ab050_caa4_4372_871f_45bc7f28ad18.slice/crio-6a335f011c59299a246a47e58cf458ff1d32d4e81388320186d4c0127c6be16a WatchSource:0}: Error finding container 6a335f011c59299a246a47e58cf458ff1d32d4e81388320186d4c0127c6be16a: Status 404 returned error can't find the container with id 6a335f011c59299a246a47e58cf458ff1d32d4e81388320186d4c0127c6be16a Oct 14 13:30:04.355920 master-0 kubenswrapper[4807]: I1014 13:30:04.355875 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-etcd/etcd-master-0" Oct 14 13:30:04.369386 master-0 kubenswrapper[4807]: I1014 13:30:04.369343 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:04.369696 master-0 kubenswrapper[4807]: I1014 13:30:04.369421 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:04.370005 master-0 kubenswrapper[4807]: E1014 13:30:04.369947 4807 secret.go:189] Couldn't get secret metallb-system/metallb-memberlist: secret "metallb-memberlist" not found Oct 14 13:30:04.370098 master-0 kubenswrapper[4807]: E1014 13:30:04.370070 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist podName:aabbab44-056d-4d23-a56c-877219e1a31f nodeName:}" failed. No retries permitted until 2025-10-14 13:30:05.3700358 +0000 UTC m=+600.051337664 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "memberlist" (UniqueName: "kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist") pod "speaker-hfvls" (UID: "aabbab44-056d-4d23-a56c-877219e1a31f") : secret "metallb-memberlist" not found Oct 14 13:30:04.376495 master-0 kubenswrapper[4807]: I1014 13:30:04.376419 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-metrics-certs\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:04.519034 master-0 kubenswrapper[4807]: I1014 13:30:04.518962 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["metallb-system/controller-68d546b9d8-9strj"] Oct 14 13:30:04.523072 master-0 kubenswrapper[4807]: W1014 13:30:04.523003 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf78dc348_fb2b_469f_8401_e2f66a301e22.slice/crio-6998983013d3b9bd6d59098e5333bcaf51aca76588979f6932a4e68169860cdb WatchSource:0}: Error finding container 6998983013d3b9bd6d59098e5333bcaf51aca76588979f6932a4e68169860cdb: Status 404 returned error can't find the container with id 6998983013d3b9bd6d59098e5333bcaf51aca76588979f6932a4e68169860cdb Oct 14 13:30:04.925758 master-0 kubenswrapper[4807]: I1014 13:30:04.925645 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"541cca9dbe7b0ed3fcb4ff5efc03c549df35bcb4e1d8e311f1621ccced75b788"} Oct 14 13:30:04.927362 master-0 kubenswrapper[4807]: I1014 13:30:04.927327 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-68d546b9d8-9strj" event={"ID":"f78dc348-fb2b-469f-8401-e2f66a301e22","Type":"ContainerStarted","Data":"132476ed25733ef56cb372a305a68bb59a044cb5c029140f64ac70af9224cd15"} Oct 14 13:30:04.927428 master-0 kubenswrapper[4807]: I1014 13:30:04.927366 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-68d546b9d8-9strj" event={"ID":"f78dc348-fb2b-469f-8401-e2f66a301e22","Type":"ContainerStarted","Data":"6998983013d3b9bd6d59098e5333bcaf51aca76588979f6932a4e68169860cdb"} Oct 14 13:30:04.928861 master-0 kubenswrapper[4807]: I1014 13:30:04.928820 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" event={"ID":"6c5ab050-caa4-4372-871f-45bc7f28ad18","Type":"ContainerStarted","Data":"6a335f011c59299a246a47e58cf458ff1d32d4e81388320186d4c0127c6be16a"} Oct 14 13:30:05.267860 master-0 kubenswrapper[4807]: I1014 13:30:05.261953 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:05.291569 master-0 kubenswrapper[4807]: I1014 13:30:05.291437 4807 kubelet.go:1909] "Trying to delete pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="9a81b7b8-6a11-43d5-a7ba-7cfca41899f2" Oct 14 13:30:05.291569 master-0 kubenswrapper[4807]: I1014 13:30:05.291564 4807 mirror_client.go:130] "Deleting a mirror pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" podUID="9a81b7b8-6a11-43d5-a7ba-7cfca41899f2" Oct 14 13:30:05.330145 master-0 kubenswrapper[4807]: I1014 13:30:05.330040 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:30:05.364132 master-0 kubenswrapper[4807]: I1014 13:30:05.364034 4807 kubelet.go:1914] "Deleted mirror pod because it is outdated" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:05.368433 master-0 kubenswrapper[4807]: I1014 13:30:05.368373 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:30:05.381331 master-0 kubenswrapper[4807]: I1014 13:30:05.381240 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:05.385243 master-0 kubenswrapper[4807]: I1014 13:30:05.385151 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memberlist\" (UniqueName: \"kubernetes.io/secret/aabbab44-056d-4d23-a56c-877219e1a31f-memberlist\") pod \"speaker-hfvls\" (UID: \"aabbab44-056d-4d23-a56c-877219e1a31f\") " pod="metallb-system/speaker-hfvls" Oct 14 13:30:05.413411 master-0 kubenswrapper[4807]: I1014 13:30:05.411159 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:05.419405 master-0 kubenswrapper[4807]: I1014 13:30:05.419343 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/kube-apiserver-master-0"] Oct 14 13:30:05.435782 master-0 kubenswrapper[4807]: W1014 13:30:05.435622 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08bb0ac7b01a53ae0dcb90ce8b66efa1.slice/crio-e6cde1af64565257543418594b1ebb46bc5f3d941c7f4e35bb2d2163c68b1898 WatchSource:0}: Error finding container e6cde1af64565257543418594b1ebb46bc5f3d941c7f4e35bb2d2163c68b1898: Status 404 returned error can't find the container with id e6cde1af64565257543418594b1ebb46bc5f3d941c7f4e35bb2d2163c68b1898 Oct 14 13:30:05.555422 master-0 kubenswrapper[4807]: I1014 13:30:05.555180 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="metallb-system/speaker-hfvls" Oct 14 13:30:05.576872 master-0 kubenswrapper[4807]: W1014 13:30:05.576797 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaabbab44_056d_4d23_a56c_877219e1a31f.slice/crio-da85449594fd8801c2fca7294835ba9faecf2108b7969c75486bf239ba9316d4 WatchSource:0}: Error finding container da85449594fd8801c2fca7294835ba9faecf2108b7969c75486bf239ba9316d4: Status 404 returned error can't find the container with id da85449594fd8801c2fca7294835ba9faecf2108b7969c75486bf239ba9316d4 Oct 14 13:30:05.940098 master-0 kubenswrapper[4807]: I1014 13:30:05.940011 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-hfvls" event={"ID":"aabbab44-056d-4d23-a56c-877219e1a31f","Type":"ContainerStarted","Data":"36c12e45e030da8a51148942a55f956106a08cbda769908b0032eac2822f41bb"} Oct 14 13:30:05.940098 master-0 kubenswrapper[4807]: I1014 13:30:05.940090 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-hfvls" event={"ID":"aabbab44-056d-4d23-a56c-877219e1a31f","Type":"ContainerStarted","Data":"da85449594fd8801c2fca7294835ba9faecf2108b7969c75486bf239ba9316d4"} Oct 14 13:30:05.942663 master-0 kubenswrapper[4807]: I1014 13:30:05.942608 4807 generic.go:334] "Generic (PLEG): container finished" podID="08bb0ac7b01a53ae0dcb90ce8b66efa1" containerID="184d643f1a4d089b49810a17ad86ce8b40bb631d49d09a669c78d8527399a208" exitCode=0 Oct 14 13:30:05.942738 master-0 kubenswrapper[4807]: I1014 13:30:05.942672 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerDied","Data":"184d643f1a4d089b49810a17ad86ce8b40bb631d49d09a669c78d8527399a208"} Oct 14 13:30:05.942738 master-0 kubenswrapper[4807]: I1014 13:30:05.942712 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"e6cde1af64565257543418594b1ebb46bc5f3d941c7f4e35bb2d2163c68b1898"} Oct 14 13:30:06.956322 master-0 kubenswrapper[4807]: I1014 13:30:06.956242 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"3ebf72b22eb469b0aeb19fd0af2e9f346dfe2cf471ee96aeaf7a720ec55c6e38"} Oct 14 13:30:06.956322 master-0 kubenswrapper[4807]: I1014 13:30:06.956311 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"d26f2b3ceb163868da14dc2eccb5a5acefafdb925ee9643dc2abcfea7e484243"} Oct 14 13:30:06.956322 master-0 kubenswrapper[4807]: I1014 13:30:06.956328 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"2e0c17079458840907f710befa2a137625daac5c14114f00761324071691816b"} Oct 14 13:30:06.956322 master-0 kubenswrapper[4807]: I1014 13:30:06.956338 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"eaa3d59e915d4135aa1108531eeff006fb7324ac0155db1dce4933cae6e79f15"} Oct 14 13:30:06.958228 master-0 kubenswrapper[4807]: I1014 13:30:06.958190 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/controller-68d546b9d8-9strj" event={"ID":"f78dc348-fb2b-469f-8401-e2f66a301e22","Type":"ContainerStarted","Data":"803dfba5f80ef683107598012bd00136f1386f7160b1d7f011228dd7c1da9421"} Oct 14 13:30:06.959282 master-0 kubenswrapper[4807]: I1014 13:30:06.959247 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:06.989678 master-0 kubenswrapper[4807]: I1014 13:30:06.989591 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/controller-68d546b9d8-9strj" podStartSLOduration=2.569133893 podStartE2EDuration="3.98957356s" podCreationTimestamp="2025-10-14 13:30:03 +0000 UTC" firstStartedPulling="2025-10-14 13:30:04.650353565 +0000 UTC m=+599.331655389" lastFinishedPulling="2025-10-14 13:30:06.070793192 +0000 UTC m=+600.752095056" observedRunningTime="2025-10-14 13:30:06.987850802 +0000 UTC m=+601.669152616" watchObservedRunningTime="2025-10-14 13:30:06.98957356 +0000 UTC m=+601.670875384" Oct 14 13:30:07.807534 master-0 kubenswrapper[4807]: I1014 13:30:07.806135 4807 patch_prober.go:28] interesting pod/kube-apiserver-guard-master-0 container/guard namespace/openshift-kube-apiserver: Readiness probe status=failure output="HTTP probe failed with statuscode: 403" start-of-body={"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"forbidden: User \"system:anonymous\" cannot get path \"/readyz\"","reason":"Forbidden","details":{},"code":403} Oct 14 13:30:07.807534 master-0 kubenswrapper[4807]: I1014 13:30:07.806221 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" podUID="78f899c2-405c-4eec-8b9c-ecb92f8bb70b" containerName="guard" probeResult="failure" output="HTTP probe failed with statuscode: 403" Oct 14 13:30:07.965785 master-0 kubenswrapper[4807]: I1014 13:30:07.965695 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/speaker-hfvls" event={"ID":"aabbab44-056d-4d23-a56c-877219e1a31f","Type":"ContainerStarted","Data":"23a946428be9dfd960cb0f4d7526ac7f22fa315095e7c0a65fe061363c375d76"} Oct 14 13:30:07.966931 master-0 kubenswrapper[4807]: I1014 13:30:07.966899 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/speaker-hfvls" Oct 14 13:30:07.974227 master-0 kubenswrapper[4807]: I1014 13:30:07.974159 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/kube-apiserver-master-0" event={"ID":"08bb0ac7b01a53ae0dcb90ce8b66efa1","Type":"ContainerStarted","Data":"d5e8a7bf0bc93328b85fd9db77c46b982e10af5ff7644afee31a3bb1e67568fa"} Oct 14 13:30:07.974381 master-0 kubenswrapper[4807]: I1014 13:30:07.974300 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:08.036591 master-0 kubenswrapper[4807]: I1014 13:30:08.033739 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/speaker-hfvls" podStartSLOduration=3.697547315 podStartE2EDuration="5.033713729s" podCreationTimestamp="2025-10-14 13:30:03 +0000 UTC" firstStartedPulling="2025-10-14 13:30:05.885311658 +0000 UTC m=+600.566613482" lastFinishedPulling="2025-10-14 13:30:07.221478072 +0000 UTC m=+601.902779896" observedRunningTime="2025-10-14 13:30:07.99999991 +0000 UTC m=+602.681301744" watchObservedRunningTime="2025-10-14 13:30:08.033713729 +0000 UTC m=+602.715015563" Oct 14 13:30:08.037915 master-0 kubenswrapper[4807]: I1014 13:30:08.037856 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-apiserver/kube-apiserver-master-0" podStartSLOduration=3.037835935 podStartE2EDuration="3.037835935s" podCreationTimestamp="2025-10-14 13:30:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:30:08.031829146 +0000 UTC m=+602.713130990" watchObservedRunningTime="2025-10-14 13:30:08.037835935 +0000 UTC m=+602.719137779" Oct 14 13:30:08.565203 master-0 kubenswrapper[4807]: I1014 13:30:08.565144 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c"] Oct 14 13:30:08.566237 master-0 kubenswrapper[4807]: I1014 13:30:08.566207 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" Oct 14 13:30:08.609488 master-0 kubenswrapper[4807]: I1014 13:30:08.598646 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk"] Oct 14 13:30:08.609488 master-0 kubenswrapper[4807]: I1014 13:30:08.599746 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.609488 master-0 kubenswrapper[4807]: I1014 13:30:08.605279 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"openshift-nmstate-webhook" Oct 14 13:30:08.616806 master-0 kubenswrapper[4807]: I1014 13:30:08.616739 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c"] Oct 14 13:30:08.621204 master-0 kubenswrapper[4807]: I1014 13:30:08.621171 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk"] Oct 14 13:30:08.629052 master-0 kubenswrapper[4807]: I1014 13:30:08.628715 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-nmstate/nmstate-handler-sbvf7"] Oct 14 13:30:08.629579 master-0 kubenswrapper[4807]: I1014 13:30:08.629551 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.753412 master-0 kubenswrapper[4807]: I1014 13:30:08.753276 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqhg9\" (UniqueName: \"kubernetes.io/projected/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-kube-api-access-nqhg9\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.753936 master-0 kubenswrapper[4807]: I1014 13:30:08.753904 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57t5b\" (UniqueName: \"kubernetes.io/projected/56544611-e79a-4a8b-ab46-239048f85bc3-kube-api-access-57t5b\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.754030 master-0 kubenswrapper[4807]: I1014 13:30:08.754006 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-ovs-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.754123 master-0 kubenswrapper[4807]: I1014 13:30:08.754096 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd82p\" (UniqueName: \"kubernetes.io/projected/86673331-76cf-4fb6-82f1-9b29dd02b918-kube-api-access-wd82p\") pod \"nmstate-metrics-fdff9cb8d-j4j8c\" (UID: \"86673331-76cf-4fb6-82f1-9b29dd02b918\") " pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" Oct 14 13:30:08.754299 master-0 kubenswrapper[4807]: I1014 13:30:08.754270 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-nmstate-lock\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.754355 master-0 kubenswrapper[4807]: I1014 13:30:08.754317 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/56544611-e79a-4a8b-ab46-239048f85bc3-tls-key-pair\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.754355 master-0 kubenswrapper[4807]: I1014 13:30:08.754351 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-dbus-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865056 master-0 kubenswrapper[4807]: I1014 13:30:08.864980 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wd82p\" (UniqueName: \"kubernetes.io/projected/86673331-76cf-4fb6-82f1-9b29dd02b918-kube-api-access-wd82p\") pod \"nmstate-metrics-fdff9cb8d-j4j8c\" (UID: \"86673331-76cf-4fb6-82f1-9b29dd02b918\") " pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" Oct 14 13:30:08.865056 master-0 kubenswrapper[4807]: I1014 13:30:08.865046 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-nmstate-lock\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865089 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/56544611-e79a-4a8b-ab46-239048f85bc3-tls-key-pair\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865121 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-dbus-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865157 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nqhg9\" (UniqueName: \"kubernetes.io/projected/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-kube-api-access-nqhg9\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865176 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-57t5b\" (UniqueName: \"kubernetes.io/projected/56544611-e79a-4a8b-ab46-239048f85bc3-kube-api-access-57t5b\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865208 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-ovs-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865377 master-0 kubenswrapper[4807]: I1014 13:30:08.865298 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-ovs-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.865962 master-0 kubenswrapper[4807]: I1014 13:30:08.865936 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nmstate-lock\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-nmstate-lock\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.869480 master-0 kubenswrapper[4807]: I1014 13:30:08.868103 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dbus-socket\" (UniqueName: \"kubernetes.io/host-path/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-dbus-socket\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.897482 master-0 kubenswrapper[4807]: I1014 13:30:08.893083 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd82p\" (UniqueName: \"kubernetes.io/projected/86673331-76cf-4fb6-82f1-9b29dd02b918-kube-api-access-wd82p\") pod \"nmstate-metrics-fdff9cb8d-j4j8c\" (UID: \"86673331-76cf-4fb6-82f1-9b29dd02b918\") " pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" Oct 14 13:30:08.905735 master-0 kubenswrapper[4807]: I1014 13:30:08.898192 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqhg9\" (UniqueName: \"kubernetes.io/projected/33ef96a1-d23e-4f7f-979c-b6c333a56b3d-kube-api-access-nqhg9\") pod \"nmstate-handler-sbvf7\" (UID: \"33ef96a1-d23e-4f7f-979c-b6c333a56b3d\") " pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:08.905735 master-0 kubenswrapper[4807]: I1014 13:30:08.901852 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" Oct 14 13:30:08.905735 master-0 kubenswrapper[4807]: I1014 13:30:08.902128 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-57t5b\" (UniqueName: \"kubernetes.io/projected/56544611-e79a-4a8b-ab46-239048f85bc3-kube-api-access-57t5b\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.919499 master-0 kubenswrapper[4807]: I1014 13:30:08.916194 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-key-pair\" (UniqueName: \"kubernetes.io/secret/56544611-e79a-4a8b-ab46-239048f85bc3-tls-key-pair\") pod \"nmstate-webhook-6cdbc54649-bj7wk\" (UID: \"56544611-e79a-4a8b-ab46-239048f85bc3\") " pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.949824 master-0 kubenswrapper[4807]: I1014 13:30:08.949768 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:08.959558 master-0 kubenswrapper[4807]: I1014 13:30:08.959507 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:09.091793 master-0 kubenswrapper[4807]: I1014 13:30:09.090217 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:30:09.108131 master-0 kubenswrapper[4807]: I1014 13:30:09.106751 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:09.108131 master-0 kubenswrapper[4807]: I1014 13:30:09.106837 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:09.392173 master-0 kubenswrapper[4807]: I1014 13:30:09.392041 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c"] Oct 14 13:30:09.604786 master-0 kubenswrapper[4807]: I1014 13:30:09.604719 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk"] Oct 14 13:30:10.012521 master-0 kubenswrapper[4807]: I1014 13:30:10.012417 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-sbvf7" event={"ID":"33ef96a1-d23e-4f7f-979c-b6c333a56b3d","Type":"ContainerStarted","Data":"51e92ddf686a04230d5aec46d0d3b506a9dda05d646c1af75d910ea01c2794c0"} Oct 14 13:30:10.412578 master-0 kubenswrapper[4807]: I1014 13:30:10.412502 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:10.412578 master-0 kubenswrapper[4807]: I1014 13:30:10.412595 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:10.422204 master-0 kubenswrapper[4807]: I1014 13:30:10.422155 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:11.023911 master-0 kubenswrapper[4807]: I1014 13:30:11.023864 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:11.454640 master-0 kubenswrapper[4807]: W1014 13:30:11.452561 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56544611_e79a_4a8b_ab46_239048f85bc3.slice/crio-679cdf76bd0a79038643cdfafd4862ffa8fa636f1ea7b3c7b30b5fa0c5c93898 WatchSource:0}: Error finding container 679cdf76bd0a79038643cdfafd4862ffa8fa636f1ea7b3c7b30b5fa0c5c93898: Status 404 returned error can't find the container with id 679cdf76bd0a79038643cdfafd4862ffa8fa636f1ea7b3c7b30b5fa0c5c93898 Oct 14 13:30:11.454640 master-0 kubenswrapper[4807]: W1014 13:30:11.454360 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86673331_76cf_4fb6_82f1_9b29dd02b918.slice/crio-e08e6795d45609752913509137ab2c4892782c9f1ee68c313b12c1a96bdc8b01 WatchSource:0}: Error finding container e08e6795d45609752913509137ab2c4892782c9f1ee68c313b12c1a96bdc8b01: Status 404 returned error can't find the container with id e08e6795d45609752913509137ab2c4892782c9f1ee68c313b12c1a96bdc8b01 Oct 14 13:30:11.705606 master-0 kubenswrapper[4807]: I1014 13:30:11.705385 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-guard-master-0" Oct 14 13:30:12.031903 master-0 kubenswrapper[4807]: I1014 13:30:12.031848 4807 generic.go:334] "Generic (PLEG): container finished" podID="37d82bf0-fc72-4e94-9f3b-73cd32e876ad" containerID="d90eaa09dc00ae6f64d39b90912a755be282ca1360a2bf2ac7b76e73b9c1f546" exitCode=0 Oct 14 13:30:12.032151 master-0 kubenswrapper[4807]: I1014 13:30:12.031967 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerDied","Data":"d90eaa09dc00ae6f64d39b90912a755be282ca1360a2bf2ac7b76e73b9c1f546"} Oct 14 13:30:12.033491 master-0 kubenswrapper[4807]: I1014 13:30:12.033437 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" event={"ID":"56544611-e79a-4a8b-ab46-239048f85bc3","Type":"ContainerStarted","Data":"679cdf76bd0a79038643cdfafd4862ffa8fa636f1ea7b3c7b30b5fa0c5c93898"} Oct 14 13:30:12.035254 master-0 kubenswrapper[4807]: I1014 13:30:12.035170 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" event={"ID":"86673331-76cf-4fb6-82f1-9b29dd02b918","Type":"ContainerStarted","Data":"e08e6795d45609752913509137ab2c4892782c9f1ee68c313b12c1a96bdc8b01"} Oct 14 13:30:12.038050 master-0 kubenswrapper[4807]: I1014 13:30:12.037954 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" event={"ID":"6c5ab050-caa4-4372-871f-45bc7f28ad18","Type":"ContainerStarted","Data":"109346d01d9189c70f3edfe75e86ad0377cd52def5bf23ec305c3a03f57e5d87"} Oct 14 13:30:12.038192 master-0 kubenswrapper[4807]: I1014 13:30:12.038142 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:13.047431 master-0 kubenswrapper[4807]: I1014 13:30:13.046613 4807 generic.go:334] "Generic (PLEG): container finished" podID="37d82bf0-fc72-4e94-9f3b-73cd32e876ad" containerID="03857b8d76c1572691fa0eb10e09fb20d3df31e73a592919ca69f9fd79e93ab4" exitCode=0 Oct 14 13:30:13.047431 master-0 kubenswrapper[4807]: I1014 13:30:13.046717 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerDied","Data":"03857b8d76c1572691fa0eb10e09fb20d3df31e73a592919ca69f9fd79e93ab4"} Oct 14 13:30:13.073799 master-0 kubenswrapper[4807]: I1014 13:30:13.073697 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" podStartSLOduration=2.669349226 podStartE2EDuration="10.073670592s" podCreationTimestamp="2025-10-14 13:30:03 +0000 UTC" firstStartedPulling="2025-10-14 13:30:04.352208698 +0000 UTC m=+599.033510522" lastFinishedPulling="2025-10-14 13:30:11.756530064 +0000 UTC m=+606.437831888" observedRunningTime="2025-10-14 13:30:12.091372134 +0000 UTC m=+606.772673968" watchObservedRunningTime="2025-10-14 13:30:13.073670592 +0000 UTC m=+607.754972416" Oct 14 13:30:14.053548 master-0 kubenswrapper[4807]: I1014 13:30:14.053491 4807 generic.go:334] "Generic (PLEG): container finished" podID="37d82bf0-fc72-4e94-9f3b-73cd32e876ad" containerID="551f5200df3fbafeabd2bed90de0111deaea275960768f9304bf9ad062abbb8a" exitCode=0 Oct 14 13:30:14.054016 master-0 kubenswrapper[4807]: I1014 13:30:14.053574 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerDied","Data":"551f5200df3fbafeabd2bed90de0111deaea275960768f9304bf9ad062abbb8a"} Oct 14 13:30:14.054683 master-0 kubenswrapper[4807]: I1014 13:30:14.054629 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" event={"ID":"56544611-e79a-4a8b-ab46-239048f85bc3","Type":"ContainerStarted","Data":"a0d73d677ac4cc55a8a3a6d537874ea8daa73d81bfea92048800e615a7e0d501"} Oct 14 13:30:14.054844 master-0 kubenswrapper[4807]: I1014 13:30:14.054762 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:14.056024 master-0 kubenswrapper[4807]: I1014 13:30:14.055965 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" event={"ID":"86673331-76cf-4fb6-82f1-9b29dd02b918","Type":"ContainerStarted","Data":"7f25d9f1c51b1ae366f5c304ad302f326f8329b4a6ae4176d576118964187269"} Oct 14 13:30:14.083753 master-0 kubenswrapper[4807]: I1014 13:30:14.083482 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" podStartSLOduration=3.757952934 podStartE2EDuration="6.083428072s" podCreationTimestamp="2025-10-14 13:30:08 +0000 UTC" firstStartedPulling="2025-10-14 13:30:11.455845515 +0000 UTC m=+606.137147349" lastFinishedPulling="2025-10-14 13:30:13.781320663 +0000 UTC m=+608.462622487" observedRunningTime="2025-10-14 13:30:14.081510248 +0000 UTC m=+608.762812082" watchObservedRunningTime="2025-10-14 13:30:14.083428072 +0000 UTC m=+608.764729916" Oct 14 13:30:14.087377 master-0 kubenswrapper[4807]: I1014 13:30:14.087316 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/controller-68d546b9d8-9strj" Oct 14 13:30:14.107110 master-0 kubenswrapper[4807]: I1014 13:30:14.107005 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:14.107110 master-0 kubenswrapper[4807]: I1014 13:30:14.107070 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:15.074331 master-0 kubenswrapper[4807]: I1014 13:30:15.074199 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" event={"ID":"86673331-76cf-4fb6-82f1-9b29dd02b918","Type":"ContainerStarted","Data":"4d4b288ea441d9e40f0c1c635307083c1a42e75a1b4191ab0821494fa99ebe26"} Oct 14 13:30:15.076421 master-0 kubenswrapper[4807]: I1014 13:30:15.076362 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-nmstate/nmstate-handler-sbvf7" event={"ID":"33ef96a1-d23e-4f7f-979c-b6c333a56b3d","Type":"ContainerStarted","Data":"5f210f158b8278b07276ee9f82d67a7df2e49b3246cb3235199a7c37e72bf621"} Oct 14 13:30:15.076541 master-0 kubenswrapper[4807]: I1014 13:30:15.076470 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:15.083058 master-0 kubenswrapper[4807]: I1014 13:30:15.083017 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"b740be25caa857a9bd986c730aeaffc762a00965decb22302178e33caac51386"} Oct 14 13:30:15.083058 master-0 kubenswrapper[4807]: I1014 13:30:15.083061 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"a720f8fd414e43d66e7d589e06c1e750c39cb6c34012bc81a6e3af898e54d623"} Oct 14 13:30:15.083289 master-0 kubenswrapper[4807]: I1014 13:30:15.083073 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"3128227d9cc2e70b676d2284fc6ebf13907ddd1b237418e6ca4be47f5490e43d"} Oct 14 13:30:15.083289 master-0 kubenswrapper[4807]: I1014 13:30:15.083088 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"7e411bbc242bbff941b3e5ff8418b2bf9f1bb22ec3047fc57e69cc90ce07e25d"} Oct 14 13:30:15.083289 master-0 kubenswrapper[4807]: I1014 13:30:15.083097 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"647c24345cc160b27dc7e2cc7e92b6ffb8289addbdb4f806645244d2cdf6d3b4"} Oct 14 13:30:15.101223 master-0 kubenswrapper[4807]: I1014 13:30:15.101141 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-metrics-fdff9cb8d-j4j8c" podStartSLOduration=4.764321709 podStartE2EDuration="7.101120696s" podCreationTimestamp="2025-10-14 13:30:08 +0000 UTC" firstStartedPulling="2025-10-14 13:30:11.459250061 +0000 UTC m=+606.140551895" lastFinishedPulling="2025-10-14 13:30:13.796049058 +0000 UTC m=+608.477350882" observedRunningTime="2025-10-14 13:30:15.098549014 +0000 UTC m=+609.779850838" watchObservedRunningTime="2025-10-14 13:30:15.101120696 +0000 UTC m=+609.782422520" Oct 14 13:30:15.357166 master-0 kubenswrapper[4807]: I1014 13:30:15.357091 4807 patch_prober.go:28] interesting pod/etcd-master-0 container/etcd namespace/openshift-etcd: Startup probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:15.357352 master-0 kubenswrapper[4807]: I1014 13:30:15.357194 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-etcd/etcd-master-0" podUID="14286286be88b59efc7cfc15eca1cc38" containerName="etcd" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:15.559696 master-0 kubenswrapper[4807]: I1014 13:30:15.559611 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/speaker-hfvls" Oct 14 13:30:15.590976 master-0 kubenswrapper[4807]: I1014 13:30:15.590864 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-nmstate/nmstate-handler-sbvf7" podStartSLOduration=2.876454165 podStartE2EDuration="7.590834978s" podCreationTimestamp="2025-10-14 13:30:08 +0000 UTC" firstStartedPulling="2025-10-14 13:30:09.024432293 +0000 UTC m=+603.705734107" lastFinishedPulling="2025-10-14 13:30:13.738813096 +0000 UTC m=+608.420114920" observedRunningTime="2025-10-14 13:30:15.127575781 +0000 UTC m=+609.808877605" watchObservedRunningTime="2025-10-14 13:30:15.590834978 +0000 UTC m=+610.272136842" Oct 14 13:30:16.099007 master-0 kubenswrapper[4807]: I1014 13:30:16.098894 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="metallb-system/frr-k8s-qqrwm" event={"ID":"37d82bf0-fc72-4e94-9f3b-73cd32e876ad","Type":"ContainerStarted","Data":"66b883fd0aeeaef590e2136f776d84e1ade0dc342705075297961667977594b9"} Oct 14 13:30:16.099724 master-0 kubenswrapper[4807]: I1014 13:30:16.099289 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:16.147778 master-0 kubenswrapper[4807]: I1014 13:30:16.139629 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="metallb-system/frr-k8s-qqrwm" podStartSLOduration=5.444923621 podStartE2EDuration="13.139607365s" podCreationTimestamp="2025-10-14 13:30:03 +0000 UTC" firstStartedPulling="2025-10-14 13:30:04.099694286 +0000 UTC m=+598.780996120" lastFinishedPulling="2025-10-14 13:30:11.79437804 +0000 UTC m=+606.475679864" observedRunningTime="2025-10-14 13:30:16.136337743 +0000 UTC m=+610.817639567" watchObservedRunningTime="2025-10-14 13:30:16.139607365 +0000 UTC m=+610.820909189" Oct 14 13:30:18.939997 master-0 kubenswrapper[4807]: I1014 13:30:18.939875 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:19.012750 master-0 kubenswrapper[4807]: I1014 13:30:19.012641 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:19.107707 master-0 kubenswrapper[4807]: I1014 13:30:19.107597 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:19.108033 master-0 kubenswrapper[4807]: I1014 13:30:19.107713 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:23.919605 master-0 kubenswrapper[4807]: I1014 13:30:23.919522 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-webhook-server-64bf5d555-sgx9c" Oct 14 13:30:23.994774 master-0 kubenswrapper[4807]: I1014 13:30:23.994671 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-handler-sbvf7" Oct 14 13:30:24.108556 master-0 kubenswrapper[4807]: I1014 13:30:24.108352 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:24.108956 master-0 kubenswrapper[4807]: I1014 13:30:24.108503 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:25.356950 master-0 kubenswrapper[4807]: I1014 13:30:25.356825 4807 patch_prober.go:28] interesting pod/etcd-master-0 container/etcd namespace/openshift-etcd: Startup probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:25.358009 master-0 kubenswrapper[4807]: I1014 13:30:25.356977 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-etcd/etcd-master-0" podUID="14286286be88b59efc7cfc15eca1cc38" containerName="etcd" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:25.419365 master-0 kubenswrapper[4807]: I1014 13:30:25.419299 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-kube-apiserver/kube-apiserver-master-0" Oct 14 13:30:28.959394 master-0 kubenswrapper[4807]: I1014 13:30:28.959312 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-nmstate/nmstate-webhook-6cdbc54649-bj7wk" Oct 14 13:30:29.109772 master-0 kubenswrapper[4807]: I1014 13:30:29.109674 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:29.110219 master-0 kubenswrapper[4807]: I1014 13:30:29.109789 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:33.944889 master-0 kubenswrapper[4807]: I1014 13:30:33.944793 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="metallb-system/frr-k8s-qqrwm" Oct 14 13:30:34.110617 master-0 kubenswrapper[4807]: I1014 13:30:34.110492 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:34.110617 master-0 kubenswrapper[4807]: I1014 13:30:34.110610 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:34.135133 master-0 kubenswrapper[4807]: I1014 13:30:34.135021 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openshift-console/console-564c479f-s9vtn" podUID="18ddf83a-8e91-4df8-b675-643f7150136a" containerName="console" containerID="cri-o://d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0" gracePeriod=15 Oct 14 13:30:34.606775 master-0 kubenswrapper[4807]: I1014 13:30:34.606696 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-564c479f-s9vtn_18ddf83a-8e91-4df8-b675-643f7150136a/console/0.log" Oct 14 13:30:34.607382 master-0 kubenswrapper[4807]: I1014 13:30:34.607351 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:30:34.637327 master-0 kubenswrapper[4807]: I1014 13:30:34.636033 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xcrwh\" (UniqueName: \"kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.637327 master-0 kubenswrapper[4807]: I1014 13:30:34.636182 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.637327 master-0 kubenswrapper[4807]: I1014 13:30:34.636407 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.637327 master-0 kubenswrapper[4807]: I1014 13:30:34.636712 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.637744 master-0 kubenswrapper[4807]: I1014 13:30:34.637587 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:30:34.638231 master-0 kubenswrapper[4807]: I1014 13:30:34.638149 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config" (OuterVolumeSpecName: "console-config") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:30:34.643739 master-0 kubenswrapper[4807]: I1014 13:30:34.643443 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh" (OuterVolumeSpecName: "kube-api-access-xcrwh") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "kube-api-access-xcrwh". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:30:34.643739 master-0 kubenswrapper[4807]: I1014 13:30:34.643566 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:30:34.668170 master-0 kubenswrapper[4807]: I1014 13:30:34.668065 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-console/console-5958979c8-mpc88"] Oct 14 13:30:34.668453 master-0 kubenswrapper[4807]: E1014 13:30:34.668433 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="18ddf83a-8e91-4df8-b675-643f7150136a" containerName="console" Oct 14 13:30:34.668453 master-0 kubenswrapper[4807]: I1014 13:30:34.668493 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="18ddf83a-8e91-4df8-b675-643f7150136a" containerName="console" Oct 14 13:30:34.668778 master-0 kubenswrapper[4807]: I1014 13:30:34.668761 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="18ddf83a-8e91-4df8-b675-643f7150136a" containerName="console" Oct 14 13:30:34.669713 master-0 kubenswrapper[4807]: I1014 13:30:34.669513 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.686798 master-0 kubenswrapper[4807]: I1014 13:30:34.686734 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5958979c8-mpc88"] Oct 14 13:30:34.738191 master-0 kubenswrapper[4807]: I1014 13:30:34.738106 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.738191 master-0 kubenswrapper[4807]: I1014 13:30:34.738180 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.738477 master-0 kubenswrapper[4807]: I1014 13:30:34.738240 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config\") pod \"18ddf83a-8e91-4df8-b675-643f7150136a\" (UID: \"18ddf83a-8e91-4df8-b675-643f7150136a\") " Oct 14 13:30:34.738477 master-0 kubenswrapper[4807]: I1014 13:30:34.738360 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-oauth-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738477 master-0 kubenswrapper[4807]: I1014 13:30:34.738445 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738623 master-0 kubenswrapper[4807]: I1014 13:30:34.738511 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59d75\" (UniqueName: \"kubernetes.io/projected/2cda9578-9f83-4956-8b1f-cb63d831f051-kube-api-access-59d75\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738623 master-0 kubenswrapper[4807]: I1014 13:30:34.738563 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-console-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738623 master-0 kubenswrapper[4807]: I1014 13:30:34.738599 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-service-ca\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738740 master-0 kubenswrapper[4807]: I1014 13:30:34.738637 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-trusted-ca-bundle\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738740 master-0 kubenswrapper[4807]: I1014 13:30:34.738670 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-oauth-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.738818 master-0 kubenswrapper[4807]: I1014 13:30:34.738748 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xcrwh\" (UniqueName: \"kubernetes.io/projected/18ddf83a-8e91-4df8-b675-643f7150136a-kube-api-access-xcrwh\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.738818 master-0 kubenswrapper[4807]: I1014 13:30:34.738771 4807 reconciler_common.go:293] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-console-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.738818 master-0 kubenswrapper[4807]: I1014 13:30:34.738790 4807 reconciler_common.go:293] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-oauth-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.738818 master-0 kubenswrapper[4807]: I1014 13:30:34.738810 4807 reconciler_common.go:293] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-serving-cert\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.739624 master-0 kubenswrapper[4807]: I1014 13:30:34.739582 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca" (OuterVolumeSpecName: "service-ca") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:30:34.739738 master-0 kubenswrapper[4807]: I1014 13:30:34.739598 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:30:34.744270 master-0 kubenswrapper[4807]: I1014 13:30:34.744221 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "18ddf83a-8e91-4df8-b675-643f7150136a" (UID: "18ddf83a-8e91-4df8-b675-643f7150136a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:30:34.839901 master-0 kubenswrapper[4807]: I1014 13:30:34.839709 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-oauth-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.839901 master-0 kubenswrapper[4807]: I1014 13:30:34.839809 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.839901 master-0 kubenswrapper[4807]: I1014 13:30:34.839838 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-59d75\" (UniqueName: \"kubernetes.io/projected/2cda9578-9f83-4956-8b1f-cb63d831f051-kube-api-access-59d75\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.839901 master-0 kubenswrapper[4807]: I1014 13:30:34.839876 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-console-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.839901 master-0 kubenswrapper[4807]: I1014 13:30:34.839904 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-service-ca\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.840413 master-0 kubenswrapper[4807]: I1014 13:30:34.839931 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-trusted-ca-bundle\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.840413 master-0 kubenswrapper[4807]: I1014 13:30:34.839959 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-oauth-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.840413 master-0 kubenswrapper[4807]: I1014 13:30:34.840028 4807 reconciler_common.go:293] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-service-ca\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.840413 master-0 kubenswrapper[4807]: I1014 13:30:34.840043 4807 reconciler_common.go:293] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/18ddf83a-8e91-4df8-b675-643f7150136a-trusted-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.840413 master-0 kubenswrapper[4807]: I1014 13:30:34.840059 4807 reconciler_common.go:293] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/18ddf83a-8e91-4df8-b675-643f7150136a-console-oauth-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:30:34.841375 master-0 kubenswrapper[4807]: I1014 13:30:34.841327 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-oauth-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.842695 master-0 kubenswrapper[4807]: I1014 13:30:34.842630 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-service-ca\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.842931 master-0 kubenswrapper[4807]: I1014 13:30:34.842852 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-trusted-ca-bundle\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.843440 master-0 kubenswrapper[4807]: I1014 13:30:34.843217 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2cda9578-9f83-4956-8b1f-cb63d831f051-console-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.845022 master-0 kubenswrapper[4807]: I1014 13:30:34.844963 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-oauth-config\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.846645 master-0 kubenswrapper[4807]: I1014 13:30:34.846583 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2cda9578-9f83-4956-8b1f-cb63d831f051-console-serving-cert\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:34.866081 master-0 kubenswrapper[4807]: I1014 13:30:34.866015 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-59d75\" (UniqueName: \"kubernetes.io/projected/2cda9578-9f83-4956-8b1f-cb63d831f051-kube-api-access-59d75\") pod \"console-5958979c8-mpc88\" (UID: \"2cda9578-9f83-4956-8b1f-cb63d831f051\") " pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:35.006529 master-0 kubenswrapper[4807]: I1014 13:30:35.006372 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:35.271773 master-0 kubenswrapper[4807]: I1014 13:30:35.271707 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-564c479f-s9vtn_18ddf83a-8e91-4df8-b675-643f7150136a/console/0.log" Oct 14 13:30:35.271956 master-0 kubenswrapper[4807]: I1014 13:30:35.271817 4807 generic.go:334] "Generic (PLEG): container finished" podID="18ddf83a-8e91-4df8-b675-643f7150136a" containerID="d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0" exitCode=2 Oct 14 13:30:35.271956 master-0 kubenswrapper[4807]: I1014 13:30:35.271879 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c479f-s9vtn" event={"ID":"18ddf83a-8e91-4df8-b675-643f7150136a","Type":"ContainerDied","Data":"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0"} Oct 14 13:30:35.271956 master-0 kubenswrapper[4807]: I1014 13:30:35.271915 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-564c479f-s9vtn" Oct 14 13:30:35.271956 master-0 kubenswrapper[4807]: I1014 13:30:35.271954 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-564c479f-s9vtn" event={"ID":"18ddf83a-8e91-4df8-b675-643f7150136a","Type":"ContainerDied","Data":"df1d5b1a507da42b248a897c635ab3992ce3818e3dcaba7f72853c7f6d952226"} Oct 14 13:30:35.272123 master-0 kubenswrapper[4807]: I1014 13:30:35.272006 4807 scope.go:117] "RemoveContainer" containerID="d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0" Oct 14 13:30:35.299843 master-0 kubenswrapper[4807]: I1014 13:30:35.299789 4807 scope.go:117] "RemoveContainer" containerID="d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0" Oct 14 13:30:35.300587 master-0 kubenswrapper[4807]: E1014 13:30:35.300537 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0\": container with ID starting with d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0 not found: ID does not exist" containerID="d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0" Oct 14 13:30:35.300650 master-0 kubenswrapper[4807]: I1014 13:30:35.300595 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0"} err="failed to get container status \"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0\": rpc error: code = NotFound desc = could not find container \"d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0\": container with ID starting with d6923ba3d8247ce1a23f4257f7ebaad4389e6363c7c3cb253c73309d19cc1db0 not found: ID does not exist" Oct 14 13:30:35.312056 master-0 kubenswrapper[4807]: I1014 13:30:35.311987 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:30:35.319939 master-0 kubenswrapper[4807]: I1014 13:30:35.319879 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5958979c8-mpc88"] Oct 14 13:30:35.327131 master-0 kubenswrapper[4807]: I1014 13:30:35.327062 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-564c479f-s9vtn"] Oct 14 13:30:35.332595 master-0 kubenswrapper[4807]: W1014 13:30:35.332540 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cda9578_9f83_4956_8b1f_cb63d831f051.slice/crio-a4d259f0f0afe156320fac854e39b05977705527f23457427a966dfb16612a6e WatchSource:0}: Error finding container a4d259f0f0afe156320fac854e39b05977705527f23457427a966dfb16612a6e: Status 404 returned error can't find the container with id a4d259f0f0afe156320fac854e39b05977705527f23457427a966dfb16612a6e Oct 14 13:30:35.356479 master-0 kubenswrapper[4807]: I1014 13:30:35.356429 4807 patch_prober.go:28] interesting pod/etcd-master-0 container/etcd namespace/openshift-etcd: Startup probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:35.356580 master-0 kubenswrapper[4807]: I1014 13:30:35.356526 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-etcd/etcd-master-0" podUID="14286286be88b59efc7cfc15eca1cc38" containerName="etcd" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:36.273000 master-0 kubenswrapper[4807]: I1014 13:30:36.272877 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18ddf83a-8e91-4df8-b675-643f7150136a" path="/var/lib/kubelet/pods/18ddf83a-8e91-4df8-b675-643f7150136a/volumes" Oct 14 13:30:36.282079 master-0 kubenswrapper[4807]: I1014 13:30:36.282024 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5958979c8-mpc88" event={"ID":"2cda9578-9f83-4956-8b1f-cb63d831f051","Type":"ContainerStarted","Data":"86c25afb55166b691cd52bee295b8820d2edcd2500b98a5b644aedcc94a55301"} Oct 14 13:30:36.282330 master-0 kubenswrapper[4807]: I1014 13:30:36.282084 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5958979c8-mpc88" event={"ID":"2cda9578-9f83-4956-8b1f-cb63d831f051","Type":"ContainerStarted","Data":"a4d259f0f0afe156320fac854e39b05977705527f23457427a966dfb16612a6e"} Oct 14 13:30:36.343068 master-0 kubenswrapper[4807]: I1014 13:30:36.342946 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-5958979c8-mpc88" podStartSLOduration=27.342916246 podStartE2EDuration="27.342916246s" podCreationTimestamp="2025-10-14 13:30:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:30:36.336598858 +0000 UTC m=+631.017900752" watchObservedRunningTime="2025-10-14 13:30:36.342916246 +0000 UTC m=+631.024218100" Oct 14 13:30:36.559313 master-0 kubenswrapper[4807]: I1014 13:30:36.559142 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-storage/vg-manager-sr6bp"] Oct 14 13:30:36.560891 master-0 kubenswrapper[4807]: I1014 13:30:36.560854 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.563590 master-0 kubenswrapper[4807]: I1014 13:30:36.563524 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"vg-manager-metrics-cert" Oct 14 13:30:36.587821 master-0 kubenswrapper[4807]: I1014 13:30:36.587727 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7v2z\" (UniqueName: \"kubernetes.io/projected/43223779-8945-410d-a5f0-b4b716de4efc-kube-api-access-t7v2z\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589053 master-0 kubenswrapper[4807]: I1014 13:30:36.587796 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-run-udev\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589053 master-0 kubenswrapper[4807]: I1014 13:30:36.588999 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-registration-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589172 master-0 kubenswrapper[4807]: I1014 13:30:36.589134 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-csi-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589380 master-0 kubenswrapper[4807]: I1014 13:30:36.589281 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-node-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589380 master-0 kubenswrapper[4807]: I1014 13:30:36.589342 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-pod-volumes-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589493 master-0 kubenswrapper[4807]: I1014 13:30:36.589442 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-lvmd-config\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589531 master-0 kubenswrapper[4807]: I1014 13:30:36.589503 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-sys\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589564 master-0 kubenswrapper[4807]: I1014 13:30:36.589536 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-device-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589593 master-0 kubenswrapper[4807]: I1014 13:30:36.589577 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43223779-8945-410d-a5f0-b4b716de4efc-metrics-cert\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.589643 master-0 kubenswrapper[4807]: I1014 13:30:36.589612 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-file-lock-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.604214 master-0 kubenswrapper[4807]: I1014 13:30:36.601787 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-sr6bp"] Oct 14 13:30:36.698907 master-0 kubenswrapper[4807]: I1014 13:30:36.698801 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-lvmd-config\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699148 master-0 kubenswrapper[4807]: I1014 13:30:36.698950 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-sys\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699148 master-0 kubenswrapper[4807]: I1014 13:30:36.699005 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-device-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699148 master-0 kubenswrapper[4807]: I1014 13:30:36.699066 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43223779-8945-410d-a5f0-b4b716de4efc-metrics-cert\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699148 master-0 kubenswrapper[4807]: I1014 13:30:36.699110 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-file-lock-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699517 master-0 kubenswrapper[4807]: I1014 13:30:36.699201 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lvmd-config\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-lvmd-config\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699517 master-0 kubenswrapper[4807]: I1014 13:30:36.699231 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-t7v2z\" (UniqueName: \"kubernetes.io/projected/43223779-8945-410d-a5f0-b4b716de4efc-kube-api-access-t7v2z\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699517 master-0 kubenswrapper[4807]: I1014 13:30:36.699267 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-device-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699517 master-0 kubenswrapper[4807]: I1014 13:30:36.699369 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-run-udev\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.699517 master-0 kubenswrapper[4807]: I1014 13:30:36.699280 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run-udev\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-run-udev\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.699705 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"file-lock-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-file-lock-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.699738 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-csi-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.699832 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-registration-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.699915 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-node-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.699988 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-pod-volumes-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.700097 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-sys\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.700159 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-registration-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700329 master-0 kubenswrapper[4807]: I1014 13:30:36.700317 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-volumes-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-pod-volumes-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700963 master-0 kubenswrapper[4807]: I1014 13:30:36.700354 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"csi-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-csi-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.700963 master-0 kubenswrapper[4807]: I1014 13:30:36.700769 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"node-plugin-dir\" (UniqueName: \"kubernetes.io/host-path/43223779-8945-410d-a5f0-b4b716de4efc-node-plugin-dir\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.705952 master-0 kubenswrapper[4807]: I1014 13:30:36.705902 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/43223779-8945-410d-a5f0-b4b716de4efc-metrics-cert\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.721915 master-0 kubenswrapper[4807]: I1014 13:30:36.721848 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7v2z\" (UniqueName: \"kubernetes.io/projected/43223779-8945-410d-a5f0-b4b716de4efc-kube-api-access-t7v2z\") pod \"vg-manager-sr6bp\" (UID: \"43223779-8945-410d-a5f0-b4b716de4efc\") " pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:36.882127 master-0 kubenswrapper[4807]: I1014 13:30:36.882039 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:37.352238 master-0 kubenswrapper[4807]: I1014 13:30:37.352141 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-storage/vg-manager-sr6bp"] Oct 14 13:30:37.361957 master-0 kubenswrapper[4807]: W1014 13:30:37.361873 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43223779_8945_410d_a5f0_b4b716de4efc.slice/crio-ad4e082edc663e23c9b38e7f699b637ed6c6945c16e97978e2ad8dd81dbd310c WatchSource:0}: Error finding container ad4e082edc663e23c9b38e7f699b637ed6c6945c16e97978e2ad8dd81dbd310c: Status 404 returned error can't find the container with id ad4e082edc663e23c9b38e7f699b637ed6c6945c16e97978e2ad8dd81dbd310c Oct 14 13:30:38.300920 master-0 kubenswrapper[4807]: I1014 13:30:38.300844 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-sr6bp" event={"ID":"43223779-8945-410d-a5f0-b4b716de4efc","Type":"ContainerStarted","Data":"bc371aa438cc76844aee3027f88ff212bee416f47519556928f86aec24d16f82"} Oct 14 13:30:38.300920 master-0 kubenswrapper[4807]: I1014 13:30:38.300894 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-sr6bp" event={"ID":"43223779-8945-410d-a5f0-b4b716de4efc","Type":"ContainerStarted","Data":"ad4e082edc663e23c9b38e7f699b637ed6c6945c16e97978e2ad8dd81dbd310c"} Oct 14 13:30:38.329768 master-0 kubenswrapper[4807]: I1014 13:30:38.329660 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-storage/vg-manager-sr6bp" podStartSLOduration=2.329636912 podStartE2EDuration="2.329636912s" podCreationTimestamp="2025-10-14 13:30:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:30:38.328875431 +0000 UTC m=+633.010177255" watchObservedRunningTime="2025-10-14 13:30:38.329636912 +0000 UTC m=+633.010938736" Oct 14 13:30:39.110983 master-0 kubenswrapper[4807]: I1014 13:30:39.110914 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:39.113443 master-0 kubenswrapper[4807]: I1014 13:30:39.111018 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:40.320719 master-0 kubenswrapper[4807]: I1014 13:30:40.320660 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-sr6bp_43223779-8945-410d-a5f0-b4b716de4efc/vg-manager/0.log" Oct 14 13:30:40.321757 master-0 kubenswrapper[4807]: I1014 13:30:40.320758 4807 generic.go:334] "Generic (PLEG): container finished" podID="43223779-8945-410d-a5f0-b4b716de4efc" containerID="bc371aa438cc76844aee3027f88ff212bee416f47519556928f86aec24d16f82" exitCode=1 Oct 14 13:30:40.321757 master-0 kubenswrapper[4807]: I1014 13:30:40.320813 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-sr6bp" event={"ID":"43223779-8945-410d-a5f0-b4b716de4efc","Type":"ContainerDied","Data":"bc371aa438cc76844aee3027f88ff212bee416f47519556928f86aec24d16f82"} Oct 14 13:30:40.321757 master-0 kubenswrapper[4807]: I1014 13:30:40.321629 4807 scope.go:117] "RemoveContainer" containerID="bc371aa438cc76844aee3027f88ff212bee416f47519556928f86aec24d16f82" Oct 14 13:30:40.610826 master-0 kubenswrapper[4807]: I1014 13:30:40.610362 4807 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock" Oct 14 13:30:40.727597 master-0 kubenswrapper[4807]: I1014 13:30:40.714390 4807 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/topolvm.io-reg.sock","Timestamp":"2025-10-14T13:30:40.610413371Z","Handler":null,"Name":""} Oct 14 13:30:40.735689 master-0 kubenswrapper[4807]: I1014 13:30:40.735621 4807 csi_plugin.go:100] kubernetes.io/csi: Trying to validate a new CSI Driver with name: topolvm.io endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock versions: 1.0.0 Oct 14 13:30:40.735945 master-0 kubenswrapper[4807]: I1014 13:30:40.735768 4807 csi_plugin.go:113] kubernetes.io/csi: Register new plugin with name: topolvm.io at endpoint: /var/lib/kubelet/plugins/topolvm.io/node/csi-topolvm.sock Oct 14 13:30:41.333451 master-0 kubenswrapper[4807]: I1014 13:30:41.333360 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-storage_vg-manager-sr6bp_43223779-8945-410d-a5f0-b4b716de4efc/vg-manager/0.log" Oct 14 13:30:41.333451 master-0 kubenswrapper[4807]: I1014 13:30:41.333440 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-storage/vg-manager-sr6bp" event={"ID":"43223779-8945-410d-a5f0-b4b716de4efc","Type":"ContainerStarted","Data":"ad9f98390e36f5be3b9da12ec08d4e51e00313317164ce5ad954cd00762394ca"} Oct 14 13:30:44.112007 master-0 kubenswrapper[4807]: I1014 13:30:44.111867 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:44.112007 master-0 kubenswrapper[4807]: I1014 13:30:44.111999 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:45.007647 master-0 kubenswrapper[4807]: I1014 13:30:45.007527 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:45.007647 master-0 kubenswrapper[4807]: I1014 13:30:45.007609 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:45.016127 master-0 kubenswrapper[4807]: I1014 13:30:45.016043 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:45.356083 master-0 kubenswrapper[4807]: I1014 13:30:45.355986 4807 patch_prober.go:28] interesting pod/etcd-master-0 container/etcd namespace/openshift-etcd: Startup probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:45.356878 master-0 kubenswrapper[4807]: I1014 13:30:45.356117 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openshift-etcd/etcd-master-0" podUID="14286286be88b59efc7cfc15eca1cc38" containerName="etcd" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:45.374490 master-0 kubenswrapper[4807]: I1014 13:30:45.374348 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5958979c8-mpc88" Oct 14 13:30:46.882905 master-0 kubenswrapper[4807]: I1014 13:30:46.882772 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:46.886204 master-0 kubenswrapper[4807]: I1014 13:30:46.886132 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:47.384969 master-0 kubenswrapper[4807]: I1014 13:30:47.384859 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:47.386162 master-0 kubenswrapper[4807]: I1014 13:30:47.386118 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-storage/vg-manager-sr6bp" Oct 14 13:30:49.112491 master-0 kubenswrapper[4807]: I1014 13:30:49.112353 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:49.112491 master-0 kubenswrapper[4807]: I1014 13:30:49.112453 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:54.113072 master-0 kubenswrapper[4807]: I1014 13:30:54.113012 4807 patch_prober.go:28] interesting pod/etcd-guard-master-0 container/guard namespace/openshift-etcd: Readiness probe status=failure output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" start-of-body= Oct 14 13:30:54.114002 master-0 kubenswrapper[4807]: I1014 13:30:54.113963 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openshift-etcd/etcd-guard-master-0" podUID="1dce93eb-a125-476a-8f6b-c704747457f6" containerName="guard" probeResult="failure" output="Get \"https://192.168.34.10:9980/readyz\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:30:54.157363 master-0 kubenswrapper[4807]: I1014 13:30:54.157273 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-guard-master-0" Oct 14 13:30:54.378012 master-0 kubenswrapper[4807]: I1014 13:30:54.377799 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-etcd/etcd-master-0" Oct 14 13:30:54.393912 master-0 kubenswrapper[4807]: I1014 13:30:54.393854 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-etcd/etcd-master-0" Oct 14 13:31:01.917918 master-0 kubenswrapper[4807]: I1014 13:31:01.917814 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:01.919076 master-0 kubenswrapper[4807]: I1014 13:31:01.918717 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:01.921498 master-0 kubenswrapper[4807]: I1014 13:31:01.921431 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"kube-root-ca.crt" Oct 14 13:31:01.921731 master-0 kubenswrapper[4807]: I1014 13:31:01.921664 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack-operators"/"openshift-service-ca.crt" Oct 14 13:31:01.936859 master-0 kubenswrapper[4807]: I1014 13:31:01.936774 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:01.989385 master-0 kubenswrapper[4807]: I1014 13:31:01.989176 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6rrg\" (UniqueName: \"kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg\") pod \"openstack-operator-index-ff576\" (UID: \"9f43184d-0f0d-42eb-90ae-f04bda9131df\") " pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:02.090818 master-0 kubenswrapper[4807]: I1014 13:31:02.090714 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z6rrg\" (UniqueName: \"kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg\") pod \"openstack-operator-index-ff576\" (UID: \"9f43184d-0f0d-42eb-90ae-f04bda9131df\") " pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:02.109270 master-0 kubenswrapper[4807]: I1014 13:31:02.109150 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6rrg\" (UniqueName: \"kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg\") pod \"openstack-operator-index-ff576\" (UID: \"9f43184d-0f0d-42eb-90ae-f04bda9131df\") " pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:02.235635 master-0 kubenswrapper[4807]: I1014 13:31:02.235304 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:02.659226 master-0 kubenswrapper[4807]: I1014 13:31:02.659117 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:03.520610 master-0 kubenswrapper[4807]: I1014 13:31:03.520523 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ff576" event={"ID":"9f43184d-0f0d-42eb-90ae-f04bda9131df","Type":"ContainerStarted","Data":"3a6141782f27c269483a03fc99fe923d6fb15e6ed8385208a4fb3159a0df6162"} Oct 14 13:31:04.271958 master-0 kubenswrapper[4807]: I1014 13:31:04.271896 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:04.680069 master-0 kubenswrapper[4807]: I1014 13:31:04.679983 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-index-nw58t"] Oct 14 13:31:04.681154 master-0 kubenswrapper[4807]: I1014 13:31:04.681115 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:04.702108 master-0 kubenswrapper[4807]: I1014 13:31:04.701962 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-nw58t"] Oct 14 13:31:04.727694 master-0 kubenswrapper[4807]: I1014 13:31:04.727628 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsl4j\" (UniqueName: \"kubernetes.io/projected/bc06b382-ac37-4768-a169-f917a445adf4-kube-api-access-nsl4j\") pod \"openstack-operator-index-nw58t\" (UID: \"bc06b382-ac37-4768-a169-f917a445adf4\") " pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:04.829257 master-0 kubenswrapper[4807]: I1014 13:31:04.829187 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nsl4j\" (UniqueName: \"kubernetes.io/projected/bc06b382-ac37-4768-a169-f917a445adf4-kube-api-access-nsl4j\") pod \"openstack-operator-index-nw58t\" (UID: \"bc06b382-ac37-4768-a169-f917a445adf4\") " pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:04.851312 master-0 kubenswrapper[4807]: I1014 13:31:04.851210 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsl4j\" (UniqueName: \"kubernetes.io/projected/bc06b382-ac37-4768-a169-f917a445adf4-kube-api-access-nsl4j\") pod \"openstack-operator-index-nw58t\" (UID: \"bc06b382-ac37-4768-a169-f917a445adf4\") " pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:05.000896 master-0 kubenswrapper[4807]: I1014 13:31:05.000703 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:05.452372 master-0 kubenswrapper[4807]: I1014 13:31:05.452324 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-index-nw58t"] Oct 14 13:31:05.458115 master-0 kubenswrapper[4807]: W1014 13:31:05.458057 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc06b382_ac37_4768_a169_f917a445adf4.slice/crio-85628c5da9605f51fe37005385b2bb35aa30a98545f53f4e0a05cd7b53261313 WatchSource:0}: Error finding container 85628c5da9605f51fe37005385b2bb35aa30a98545f53f4e0a05cd7b53261313: Status 404 returned error can't find the container with id 85628c5da9605f51fe37005385b2bb35aa30a98545f53f4e0a05cd7b53261313 Oct 14 13:31:05.538988 master-0 kubenswrapper[4807]: I1014 13:31:05.538910 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-nw58t" event={"ID":"bc06b382-ac37-4768-a169-f917a445adf4","Type":"ContainerStarted","Data":"85628c5da9605f51fe37005385b2bb35aa30a98545f53f4e0a05cd7b53261313"} Oct 14 13:31:11.584887 master-0 kubenswrapper[4807]: I1014 13:31:11.584778 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-nw58t" event={"ID":"bc06b382-ac37-4768-a169-f917a445adf4","Type":"ContainerStarted","Data":"0160e7f019d73c32767df84f32bbcb3d3ee9e82c356bb61893520c19ac127568"} Oct 14 13:31:11.589357 master-0 kubenswrapper[4807]: I1014 13:31:11.589298 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ff576" event={"ID":"9f43184d-0f0d-42eb-90ae-f04bda9131df","Type":"ContainerStarted","Data":"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d"} Oct 14 13:31:11.589648 master-0 kubenswrapper[4807]: I1014 13:31:11.589516 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-index-ff576" podUID="9f43184d-0f0d-42eb-90ae-f04bda9131df" containerName="registry-server" containerID="cri-o://671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d" gracePeriod=2 Oct 14 13:31:11.614668 master-0 kubenswrapper[4807]: I1014 13:31:11.614211 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-nw58t" podStartSLOduration=2.147444819 podStartE2EDuration="7.614191173s" podCreationTimestamp="2025-10-14 13:31:04 +0000 UTC" firstStartedPulling="2025-10-14 13:31:05.46329296 +0000 UTC m=+660.144594794" lastFinishedPulling="2025-10-14 13:31:10.930039324 +0000 UTC m=+665.611341148" observedRunningTime="2025-10-14 13:31:11.612928348 +0000 UTC m=+666.294230202" watchObservedRunningTime="2025-10-14 13:31:11.614191173 +0000 UTC m=+666.295492997" Oct 14 13:31:11.641990 master-0 kubenswrapper[4807]: I1014 13:31:11.641847 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-index-ff576" podStartSLOduration=2.3990812 podStartE2EDuration="10.641811571s" podCreationTimestamp="2025-10-14 13:31:01 +0000 UTC" firstStartedPulling="2025-10-14 13:31:02.672636229 +0000 UTC m=+657.353938093" lastFinishedPulling="2025-10-14 13:31:10.91536664 +0000 UTC m=+665.596668464" observedRunningTime="2025-10-14 13:31:11.638874499 +0000 UTC m=+666.320176363" watchObservedRunningTime="2025-10-14 13:31:11.641811571 +0000 UTC m=+666.323113435" Oct 14 13:31:12.117569 master-0 kubenswrapper[4807]: I1014 13:31:12.117528 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:12.219787 master-0 kubenswrapper[4807]: I1014 13:31:12.219713 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6rrg\" (UniqueName: \"kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg\") pod \"9f43184d-0f0d-42eb-90ae-f04bda9131df\" (UID: \"9f43184d-0f0d-42eb-90ae-f04bda9131df\") " Oct 14 13:31:12.223103 master-0 kubenswrapper[4807]: I1014 13:31:12.223039 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg" (OuterVolumeSpecName: "kube-api-access-z6rrg") pod "9f43184d-0f0d-42eb-90ae-f04bda9131df" (UID: "9f43184d-0f0d-42eb-90ae-f04bda9131df"). InnerVolumeSpecName "kube-api-access-z6rrg". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:31:12.322055 master-0 kubenswrapper[4807]: I1014 13:31:12.321976 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-z6rrg\" (UniqueName: \"kubernetes.io/projected/9f43184d-0f0d-42eb-90ae-f04bda9131df-kube-api-access-z6rrg\") on node \"master-0\" DevicePath \"\"" Oct 14 13:31:12.599501 master-0 kubenswrapper[4807]: I1014 13:31:12.599268 4807 generic.go:334] "Generic (PLEG): container finished" podID="9f43184d-0f0d-42eb-90ae-f04bda9131df" containerID="671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d" exitCode=0 Oct 14 13:31:12.599501 master-0 kubenswrapper[4807]: I1014 13:31:12.599408 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-index-ff576" Oct 14 13:31:12.600787 master-0 kubenswrapper[4807]: I1014 13:31:12.599516 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ff576" event={"ID":"9f43184d-0f0d-42eb-90ae-f04bda9131df","Type":"ContainerDied","Data":"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d"} Oct 14 13:31:12.600787 master-0 kubenswrapper[4807]: I1014 13:31:12.599608 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-index-ff576" event={"ID":"9f43184d-0f0d-42eb-90ae-f04bda9131df","Type":"ContainerDied","Data":"3a6141782f27c269483a03fc99fe923d6fb15e6ed8385208a4fb3159a0df6162"} Oct 14 13:31:12.600787 master-0 kubenswrapper[4807]: I1014 13:31:12.599670 4807 scope.go:117] "RemoveContainer" containerID="671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d" Oct 14 13:31:12.621253 master-0 kubenswrapper[4807]: I1014 13:31:12.621199 4807 scope.go:117] "RemoveContainer" containerID="671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d" Oct 14 13:31:12.621851 master-0 kubenswrapper[4807]: E1014 13:31:12.621793 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d\": container with ID starting with 671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d not found: ID does not exist" containerID="671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d" Oct 14 13:31:12.622019 master-0 kubenswrapper[4807]: I1014 13:31:12.621855 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d"} err="failed to get container status \"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d\": rpc error: code = NotFound desc = could not find container \"671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d\": container with ID starting with 671d9131ca6c71fa9d85862aae278669c35327b6a4971915420696b382f0de0d not found: ID does not exist" Oct 14 13:31:12.632167 master-0 kubenswrapper[4807]: I1014 13:31:12.632107 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:12.640672 master-0 kubenswrapper[4807]: I1014 13:31:12.640621 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-index-ff576"] Oct 14 13:31:14.274853 master-0 kubenswrapper[4807]: I1014 13:31:14.274728 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f43184d-0f0d-42eb-90ae-f04bda9131df" path="/var/lib/kubelet/pods/9f43184d-0f0d-42eb-90ae-f04bda9131df/volumes" Oct 14 13:31:15.001918 master-0 kubenswrapper[4807]: I1014 13:31:15.001830 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:15.001918 master-0 kubenswrapper[4807]: I1014 13:31:15.001887 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:15.036234 master-0 kubenswrapper[4807]: I1014 13:31:15.036152 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:25.046766 master-0 kubenswrapper[4807]: I1014 13:31:25.046675 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-index-nw58t" Oct 14 13:31:41.816624 master-0 kubenswrapper[4807]: I1014 13:31:41.816340 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:31:41.817435 master-0 kubenswrapper[4807]: E1014 13:31:41.816811 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9f43184d-0f0d-42eb-90ae-f04bda9131df" containerName="registry-server" Oct 14 13:31:41.817435 master-0 kubenswrapper[4807]: I1014 13:31:41.816837 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f43184d-0f0d-42eb-90ae-f04bda9131df" containerName="registry-server" Oct 14 13:31:41.817435 master-0 kubenswrapper[4807]: I1014 13:31:41.817068 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="9f43184d-0f0d-42eb-90ae-f04bda9131df" containerName="registry-server" Oct 14 13:31:41.818300 master-0 kubenswrapper[4807]: I1014 13:31:41.818256 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:41.854225 master-0 kubenswrapper[4807]: I1014 13:31:41.854137 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:31:41.972061 master-0 kubenswrapper[4807]: I1014 13:31:41.971918 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hhhc\" (UniqueName: \"kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc\") pod \"openstack-operator-controller-operator-64895cd698-tkclq\" (UID: \"1051c867-07ce-4c23-b0b5-b76e4713d400\") " pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:42.073915 master-0 kubenswrapper[4807]: I1014 13:31:42.073682 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5hhhc\" (UniqueName: \"kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc\") pod \"openstack-operator-controller-operator-64895cd698-tkclq\" (UID: \"1051c867-07ce-4c23-b0b5-b76e4713d400\") " pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:42.099275 master-0 kubenswrapper[4807]: I1014 13:31:42.099187 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hhhc\" (UniqueName: \"kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc\") pod \"openstack-operator-controller-operator-64895cd698-tkclq\" (UID: \"1051c867-07ce-4c23-b0b5-b76e4713d400\") " pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:42.147180 master-0 kubenswrapper[4807]: I1014 13:31:42.144846 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:42.591762 master-0 kubenswrapper[4807]: I1014 13:31:42.591703 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:31:42.600233 master-0 kubenswrapper[4807]: W1014 13:31:42.600161 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1051c867_07ce_4c23_b0b5_b76e4713d400.slice/crio-5570c38306c7ea37a7ec1fe8e9a392deeccf143f731b101a35c338db933f3e51 WatchSource:0}: Error finding container 5570c38306c7ea37a7ec1fe8e9a392deeccf143f731b101a35c338db933f3e51: Status 404 returned error can't find the container with id 5570c38306c7ea37a7ec1fe8e9a392deeccf143f731b101a35c338db933f3e51 Oct 14 13:31:42.861661 master-0 kubenswrapper[4807]: I1014 13:31:42.861555 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerStarted","Data":"5570c38306c7ea37a7ec1fe8e9a392deeccf143f731b101a35c338db933f3e51"} Oct 14 13:31:46.890966 master-0 kubenswrapper[4807]: I1014 13:31:46.890880 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerStarted","Data":"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c"} Oct 14 13:31:48.909208 master-0 kubenswrapper[4807]: I1014 13:31:48.908293 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerStarted","Data":"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f"} Oct 14 13:31:48.909208 master-0 kubenswrapper[4807]: I1014 13:31:48.909189 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:48.975193 master-0 kubenswrapper[4807]: I1014 13:31:48.975109 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" podStartSLOduration=2.417459052 podStartE2EDuration="7.975091176s" podCreationTimestamp="2025-10-14 13:31:41 +0000 UTC" firstStartedPulling="2025-10-14 13:31:42.604260148 +0000 UTC m=+697.285561972" lastFinishedPulling="2025-10-14 13:31:48.161892272 +0000 UTC m=+702.843194096" observedRunningTime="2025-10-14 13:31:48.971848844 +0000 UTC m=+703.653150688" watchObservedRunningTime="2025-10-14 13:31:48.975091176 +0000 UTC m=+703.656393000" Oct 14 13:31:52.149982 master-0 kubenswrapper[4807]: I1014 13:31:52.149882 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:31:54.668294 master-0 kubenswrapper[4807]: I1014 13:31:54.668192 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m"] Oct 14 13:31:54.670267 master-0 kubenswrapper[4807]: I1014 13:31:54.670212 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:54.734575 master-0 kubenswrapper[4807]: I1014 13:31:54.731353 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m"] Oct 14 13:31:54.762386 master-0 kubenswrapper[4807]: I1014 13:31:54.762310 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkt9w\" (UniqueName: \"kubernetes.io/projected/8665789e-10d7-45da-8162-3d11286ef8a2-kube-api-access-fkt9w\") pod \"openstack-operator-controller-operator-548bfb9499-crk7m\" (UID: \"8665789e-10d7-45da-8162-3d11286ef8a2\") " pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:54.863928 master-0 kubenswrapper[4807]: I1014 13:31:54.863779 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-fkt9w\" (UniqueName: \"kubernetes.io/projected/8665789e-10d7-45da-8162-3d11286ef8a2-kube-api-access-fkt9w\") pod \"openstack-operator-controller-operator-548bfb9499-crk7m\" (UID: \"8665789e-10d7-45da-8162-3d11286ef8a2\") " pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:54.889326 master-0 kubenswrapper[4807]: I1014 13:31:54.889134 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkt9w\" (UniqueName: \"kubernetes.io/projected/8665789e-10d7-45da-8162-3d11286ef8a2-kube-api-access-fkt9w\") pod \"openstack-operator-controller-operator-548bfb9499-crk7m\" (UID: \"8665789e-10d7-45da-8162-3d11286ef8a2\") " pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:55.025964 master-0 kubenswrapper[4807]: I1014 13:31:55.025735 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:55.551082 master-0 kubenswrapper[4807]: I1014 13:31:55.550675 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m"] Oct 14 13:31:55.564199 master-0 kubenswrapper[4807]: W1014 13:31:55.564148 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8665789e_10d7_45da_8162_3d11286ef8a2.slice/crio-f519eac9709f7c472d5485f3204b9d6994a94872cbc8c2dab75c9c2be5bb3ab4 WatchSource:0}: Error finding container f519eac9709f7c472d5485f3204b9d6994a94872cbc8c2dab75c9c2be5bb3ab4: Status 404 returned error can't find the container with id f519eac9709f7c472d5485f3204b9d6994a94872cbc8c2dab75c9c2be5bb3ab4 Oct 14 13:31:55.970963 master-0 kubenswrapper[4807]: I1014 13:31:55.970866 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" event={"ID":"8665789e-10d7-45da-8162-3d11286ef8a2","Type":"ContainerStarted","Data":"53a8eea8270adca111a65aecb249ecaf531c9f61c19d94ed2c7dabd0be0f649e"} Oct 14 13:31:55.971810 master-0 kubenswrapper[4807]: I1014 13:31:55.970988 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" event={"ID":"8665789e-10d7-45da-8162-3d11286ef8a2","Type":"ContainerStarted","Data":"df2e14f3f818a66f67658768fd8c97120f692cdbfcf211d676bb5ec628dabc83"} Oct 14 13:31:55.971810 master-0 kubenswrapper[4807]: I1014 13:31:55.971009 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" event={"ID":"8665789e-10d7-45da-8162-3d11286ef8a2","Type":"ContainerStarted","Data":"f519eac9709f7c472d5485f3204b9d6994a94872cbc8c2dab75c9c2be5bb3ab4"} Oct 14 13:31:55.971810 master-0 kubenswrapper[4807]: I1014 13:31:55.971139 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:31:56.028756 master-0 kubenswrapper[4807]: I1014 13:31:56.028575 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" podStartSLOduration=2.02853539 podStartE2EDuration="2.02853539s" podCreationTimestamp="2025-10-14 13:31:54 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:31:56.022069298 +0000 UTC m=+710.703371162" watchObservedRunningTime="2025-10-14 13:31:56.02853539 +0000 UTC m=+710.709837254" Oct 14 13:32:05.029498 master-0 kubenswrapper[4807]: I1014 13:32:05.029379 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/openstack-operator-controller-operator-548bfb9499-crk7m" Oct 14 13:32:05.175825 master-0 kubenswrapper[4807]: I1014 13:32:05.175751 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:32:05.176175 master-0 kubenswrapper[4807]: I1014 13:32:05.176099 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="operator" containerID="cri-o://b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" gracePeriod=10 Oct 14 13:32:05.176684 master-0 kubenswrapper[4807]: I1014 13:32:05.176658 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="kube-rbac-proxy" containerID="cri-o://36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" gracePeriod=10 Oct 14 13:32:05.702629 master-0 kubenswrapper[4807]: I1014 13:32:05.702541 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:32:05.824817 master-0 kubenswrapper[4807]: I1014 13:32:05.824687 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hhhc\" (UniqueName: \"kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc\") pod \"1051c867-07ce-4c23-b0b5-b76e4713d400\" (UID: \"1051c867-07ce-4c23-b0b5-b76e4713d400\") " Oct 14 13:32:05.830582 master-0 kubenswrapper[4807]: I1014 13:32:05.830504 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc" (OuterVolumeSpecName: "kube-api-access-5hhhc") pod "1051c867-07ce-4c23-b0b5-b76e4713d400" (UID: "1051c867-07ce-4c23-b0b5-b76e4713d400"). InnerVolumeSpecName "kube-api-access-5hhhc". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:32:05.927155 master-0 kubenswrapper[4807]: I1014 13:32:05.926960 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5hhhc\" (UniqueName: \"kubernetes.io/projected/1051c867-07ce-4c23-b0b5-b76e4713d400-kube-api-access-5hhhc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:32:06.064908 master-0 kubenswrapper[4807]: I1014 13:32:06.064799 4807 generic.go:334] "Generic (PLEG): container finished" podID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerID="36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" exitCode=0 Oct 14 13:32:06.064908 master-0 kubenswrapper[4807]: I1014 13:32:06.064861 4807 generic.go:334] "Generic (PLEG): container finished" podID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerID="b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" exitCode=0 Oct 14 13:32:06.064908 master-0 kubenswrapper[4807]: I1014 13:32:06.064906 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerDied","Data":"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f"} Oct 14 13:32:06.065904 master-0 kubenswrapper[4807]: I1014 13:32:06.064967 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerDied","Data":"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c"} Oct 14 13:32:06.065904 master-0 kubenswrapper[4807]: I1014 13:32:06.064992 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" event={"ID":"1051c867-07ce-4c23-b0b5-b76e4713d400","Type":"ContainerDied","Data":"5570c38306c7ea37a7ec1fe8e9a392deeccf143f731b101a35c338db933f3e51"} Oct 14 13:32:06.065904 master-0 kubenswrapper[4807]: I1014 13:32:06.065006 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq" Oct 14 13:32:06.065904 master-0 kubenswrapper[4807]: I1014 13:32:06.065026 4807 scope.go:117] "RemoveContainer" containerID="36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" Oct 14 13:32:06.090247 master-0 kubenswrapper[4807]: I1014 13:32:06.090174 4807 scope.go:117] "RemoveContainer" containerID="b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" Oct 14 13:32:06.124450 master-0 kubenswrapper[4807]: I1014 13:32:06.124346 4807 scope.go:117] "RemoveContainer" containerID="36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" Oct 14 13:32:06.125370 master-0 kubenswrapper[4807]: E1014 13:32:06.125300 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f\": container with ID starting with 36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f not found: ID does not exist" containerID="36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" Oct 14 13:32:06.125533 master-0 kubenswrapper[4807]: I1014 13:32:06.125399 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f"} err="failed to get container status \"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f\": rpc error: code = NotFound desc = could not find container \"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f\": container with ID starting with 36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f not found: ID does not exist" Oct 14 13:32:06.125533 master-0 kubenswrapper[4807]: I1014 13:32:06.125447 4807 scope.go:117] "RemoveContainer" containerID="b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" Oct 14 13:32:06.127280 master-0 kubenswrapper[4807]: E1014 13:32:06.127211 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c\": container with ID starting with b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c not found: ID does not exist" containerID="b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" Oct 14 13:32:06.127280 master-0 kubenswrapper[4807]: I1014 13:32:06.127267 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c"} err="failed to get container status \"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c\": rpc error: code = NotFound desc = could not find container \"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c\": container with ID starting with b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c not found: ID does not exist" Oct 14 13:32:06.127280 master-0 kubenswrapper[4807]: I1014 13:32:06.127288 4807 scope.go:117] "RemoveContainer" containerID="36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f" Oct 14 13:32:06.128693 master-0 kubenswrapper[4807]: I1014 13:32:06.128584 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f"} err="failed to get container status \"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f\": rpc error: code = NotFound desc = could not find container \"36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f\": container with ID starting with 36a030717f547664f3f3c5c1678f67ef94e0ccbb44a409b7ea152345d9b91f2f not found: ID does not exist" Oct 14 13:32:06.128693 master-0 kubenswrapper[4807]: I1014 13:32:06.128689 4807 scope.go:117] "RemoveContainer" containerID="b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c" Oct 14 13:32:06.130866 master-0 kubenswrapper[4807]: I1014 13:32:06.130774 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c"} err="failed to get container status \"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c\": rpc error: code = NotFound desc = could not find container \"b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c\": container with ID starting with b74e8ddc7ef9c66290672152f2c2c6efbd0ce5b8d18d21ad79b291d97b38200c not found: ID does not exist" Oct 14 13:32:06.153953 master-0 kubenswrapper[4807]: I1014 13:32:06.153885 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:32:06.180447 master-0 kubenswrapper[4807]: I1014 13:32:06.180279 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack-operators/openstack-operator-controller-operator-64895cd698-tkclq"] Oct 14 13:32:06.277091 master-0 kubenswrapper[4807]: I1014 13:32:06.276970 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" path="/var/lib/kubelet/pods/1051c867-07ce-4c23-b0b5-b76e4713d400/volumes" Oct 14 13:32:52.233427 master-0 kubenswrapper[4807]: I1014 13:32:52.233320 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-tls" Oct 14 13:32:52.235456 master-0 kubenswrapper[4807]: I1014 13:32:52.235388 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"canary-serving-cert" Oct 14 13:32:52.293980 master-0 kubenswrapper[4807]: I1014 13:32:52.293890 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"node-resolver-dockercfg-9lm9q" Oct 14 13:32:52.310995 master-0 kubenswrapper[4807]: I1014 13:32:52.310920 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ingress-canary"/"default-dockercfg-fslmn" Oct 14 13:32:52.316055 master-0 kubenswrapper[4807]: I1014 13:32:52.315999 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-cert" Oct 14 13:32:52.325162 master-0 kubenswrapper[4807]: I1014 13:32:52.325087 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls" Oct 14 13:32:52.332375 master-0 kubenswrapper[4807]: I1014 13:32:52.332323 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-node-identity"/"network-node-identity-dockercfg-nrnqw" Oct 14 13:32:52.337231 master-0 kubenswrapper[4807]: I1014 13:32:52.337171 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-daemon-dockercfg-j2xzg" Oct 14 13:32:52.367532 master-0 kubenswrapper[4807]: I1014 13:32:52.367431 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-dockercfg-r2r7j" Oct 14 13:32:52.386330 master-0 kubenswrapper[4807]: I1014 13:32:52.386282 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-metrics-cert" Oct 14 13:32:52.403940 master-0 kubenswrapper[4807]: I1014 13:32:52.403900 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-dockercfg-z89cl" Oct 14 13:32:52.406011 master-0 kubenswrapper[4807]: I1014 13:32:52.405957 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"default-dockercfg-cxvsj" Oct 14 13:32:52.412424 master-0 kubenswrapper[4807]: I1014 13:32:52.412354 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-controller-manager-service-cert" Oct 14 13:32:52.413847 master-0 kubenswrapper[4807]: I1014 13:32:52.413796 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-storage"/"lvms-operator-service-cert" Oct 14 13:32:52.414026 master-0 kubenswrapper[4807]: I1014 13:32:52.414002 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"controller-certs-secret" Oct 14 13:32:52.424281 master-0 kubenswrapper[4807]: I1014 13:32:52.424243 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-dockercfg-cf2b7" Oct 14 13:32:52.432443 master-0 kubenswrapper[4807]: I1014 13:32:52.432370 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"serving-cert" Oct 14 13:32:52.446812 master-0 kubenswrapper[4807]: I1014 13:32:52.446747 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-error" Oct 14 13:32:52.447793 master-0 kubenswrapper[4807]: I1014 13:32:52.447753 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-secret" Oct 14 13:32:52.471859 master-0 kubenswrapper[4807]: I1014 13:32:52.471713 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"proxy-tls" Oct 14 13:32:52.473579 master-0 kubenswrapper[4807]: I1014 13:32:52.473257 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-scheduler"/"default-dockercfg-kszsm" Oct 14 13:32:52.474176 master-0 kubenswrapper[4807]: I1014 13:32:52.474139 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-session" Oct 14 13:32:52.485593 master-0 kubenswrapper[4807]: I1014 13:32:52.485431 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"etcd-client" Oct 14 13:32:52.495822 master-0 kubenswrapper[4807]: I1014 13:32:52.495748 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-operator-webhook-server-service-cert" Oct 14 13:32:52.498259 master-0 kubenswrapper[4807]: I1014 13:32:52.498188 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-ocp-branding-template" Oct 14 13:32:52.501081 master-0 kubenswrapper[4807]: I1014 13:32:52.501040 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-etcd"/"default-dockercfg-xsnqg" Oct 14 13:32:52.503380 master-0 kubenswrapper[4807]: I1014 13:32:52.503344 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-web" Oct 14 13:32:52.503981 master-0 kubenswrapper[4807]: I1014 13:32:52.503923 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"speaker-certs-secret" Oct 14 13:32:52.526211 master-0 kubenswrapper[4807]: I1014 13:32:52.526144 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-provider-selection" Oct 14 13:32:52.539100 master-0 kubenswrapper[4807]: I1014 13:32:52.539046 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-dns"/"dns-default-metrics-tls" Oct 14 13:32:52.594927 master-0 kubenswrapper[4807]: I1014 13:32:52.594870 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-serving-cert" Oct 14 13:32:52.622008 master-0 kubenswrapper[4807]: I1014 13:32:52.621944 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"obo-prometheus-operator-admission-webhook-service-cert" Oct 14 13:32:52.622274 master-0 kubenswrapper[4807]: I1014 13:32:52.622175 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-kube-rbac-proxy-config" Oct 14 13:32:52.633315 master-0 kubenswrapper[4807]: I1014 13:32:52.633264 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy" Oct 14 13:32:52.638078 master-0 kubenswrapper[4807]: I1014 13:32:52.638037 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-webhook-server-cert" Oct 14 13:32:52.663569 master-0 kubenswrapper[4807]: I1014 13:32:52.663507 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"node-bootstrapper-token" Oct 14 13:32:52.665921 master-0 kubenswrapper[4807]: I1014 13:32:52.665888 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-dockercfg-xxth4" Oct 14 13:32:52.673322 master-0 kubenswrapper[4807]: I1014 13:32:52.673276 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-nmstate"/"openshift-nmstate-webhook" Oct 14 13:32:52.679750 master-0 kubenswrapper[4807]: I1014 13:32:52.679689 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-image-registry"/"node-ca-dockercfg-svq88" Oct 14 13:32:52.681464 master-0 kubenswrapper[4807]: I1014 13:32:52.681425 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"serving-cert" Oct 14 13:32:52.700506 master-0 kubenswrapper[4807]: I1014 13:32:52.700425 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"route-controller-manager-sa-dockercfg-t6l59" Oct 14 13:32:52.710686 master-0 kubenswrapper[4807]: I1014 13:32:52.710621 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-route-controller-manager"/"serving-cert" Oct 14 13:32:52.711091 master-0 kubenswrapper[4807]: I1014 13:32:52.711057 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-memberlist" Oct 14 13:32:52.717000 master-0 kubenswrapper[4807]: I1014 13:32:52.716939 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-kube-rbac-proxy-metric" Oct 14 13:32:52.720721 master-0 kubenswrapper[4807]: I1014 13:32:52.720677 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-web-config" Oct 14 13:32:52.748835 master-0 kubenswrapper[4807]: I1014 13:32:52.748675 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-3mlibjliosje2" Oct 14 13:32:52.748835 master-0 kubenswrapper[4807]: I1014 13:32:52.748793 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-controller-manager"/"openshift-controller-manager-sa-dockercfg-2zbrt" Oct 14 13:32:52.754966 master-0 kubenswrapper[4807]: I1014 13:32:52.754920 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-kubernetes-node-dockercfg-hlhhv" Oct 14 13:32:52.755136 master-0 kubenswrapper[4807]: I1014 13:32:52.754967 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-user-template-login" Oct 14 13:32:52.756947 master-0 kubenswrapper[4807]: I1014 13:32:52.756904 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-client-certs" Oct 14 13:32:52.764039 master-0 kubenswrapper[4807]: I1014 13:32:52.763991 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"metrics-daemon-sa-dockercfg-c42q9" Oct 14 13:32:52.768428 master-0 kubenswrapper[4807]: I1014 13:32:52.768361 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-tls" Oct 14 13:32:52.773107 master-0 kubenswrapper[4807]: I1014 13:32:52.773050 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"metrics-server-dockercfg-bg9tg" Oct 14 13:32:52.784345 master-0 kubenswrapper[4807]: I1014 13:32:52.784248 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"frr-k8s-certs-secret" Oct 14 13:32:52.788546 master-0 kubenswrapper[4807]: I1014 13:32:52.788454 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"openshift-apiserver-sa-dockercfg-95k8q" Oct 14 13:32:52.800281 master-0 kubenswrapper[4807]: I1014 13:32:52.800220 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-operators"/"observability-operator-tls" Oct 14 13:32:52.804241 master-0 kubenswrapper[4807]: I1014 13:32:52.804190 4807 reflector.go:368] Caches populated for *v1.Secret from object-"metallb-system"/"metallb-webhook-cert" Oct 14 13:32:52.805296 master-0 kubenswrapper[4807]: I1014 13:32:52.805254 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-machine-config-operator"/"machine-config-server-tls" Oct 14 13:32:52.831571 master-0 kubenswrapper[4807]: I1014 13:32:52.831505 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-multus"/"multus-ancillary-tools-dockercfg-x97tr" Oct 14 13:32:52.835539 master-0 kubenswrapper[4807]: I1014 13:32:52.835482 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"v4-0-config-system-router-certs" Oct 14 13:32:52.862339 master-0 kubenswrapper[4807]: I1014 13:32:52.862235 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-diagnostics"/"default-dockercfg-ss7x7" Oct 14 13:32:52.880449 master-0 kubenswrapper[4807]: I1014 13:32:52.880381 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"default-dockercfg-pd7qg" Oct 14 13:32:52.885333 master-0 kubenswrapper[4807]: I1014 13:32:52.885286 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"node-exporter-dockercfg-fk8vl" Oct 14 13:32:52.897146 master-0 kubenswrapper[4807]: I1014 13:32:52.897068 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-authentication"/"oauth-openshift-dockercfg-5vqgl" Oct 14 13:32:52.903516 master-0 kubenswrapper[4807]: I1014 13:32:52.903420 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-ovn-kubernetes"/"ovn-node-metrics-cert" Oct 14 13:32:52.908608 master-0 kubenswrapper[4807]: I1014 13:32:52.908564 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-oauth-config" Oct 14 13:32:52.918073 master-0 kubenswrapper[4807]: I1014 13:32:52.918016 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-console"/"console-serving-cert" Oct 14 13:32:52.935388 master-0 kubenswrapper[4807]: I1014 13:32:52.935330 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-apiserver"/"encryption-config-1" Oct 14 13:32:52.974842 master-0 kubenswrapper[4807]: I1014 13:32:52.974792 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-network-operator"/"iptables-alerter-dockercfg-hkq8s" Oct 14 13:32:52.987669 master-0 kubenswrapper[4807]: I1014 13:32:52.987629 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-generated" Oct 14 13:32:52.995609 master-0 kubenswrapper[4807]: I1014 13:32:52.995560 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-monitoring"/"alertmanager-main-tls-assets-0" Oct 14 13:32:53.018888 master-0 kubenswrapper[4807]: I1014 13:32:53.018748 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-cluster-node-tuning-operator"/"tuned-dockercfg-n86t7" Oct 14 13:33:04.999009 master-0 kubenswrapper[4807]: I1014 13:33:04.998866 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf"] Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: E1014 13:33:04.999172 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="operator" Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: I1014 13:33:04.999190 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="operator" Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: E1014 13:33:04.999207 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="kube-rbac-proxy" Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: I1014 13:33:04.999216 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="kube-rbac-proxy" Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: I1014 13:33:04.999449 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="operator" Oct 14 13:33:05.000242 master-0 kubenswrapper[4807]: I1014 13:33:04.999504 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="1051c867-07ce-4c23-b0b5-b76e4713d400" containerName="kube-rbac-proxy" Oct 14 13:33:05.000550 master-0 kubenswrapper[4807]: I1014 13:33:05.000521 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:05.034709 master-0 kubenswrapper[4807]: I1014 13:33:05.033655 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf"] Oct 14 13:33:05.069030 master-0 kubenswrapper[4807]: I1014 13:33:05.068944 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb6rf\" (UniqueName: \"kubernetes.io/projected/e055f29e-803b-4347-938c-1b4f34f82c4e-kube-api-access-mb6rf\") pod \"barbican-operator-controller-manager-658c7b459c-pwzgf\" (UID: \"e055f29e-803b-4347-938c-1b4f34f82c4e\") " pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:05.170076 master-0 kubenswrapper[4807]: I1014 13:33:05.170021 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mb6rf\" (UniqueName: \"kubernetes.io/projected/e055f29e-803b-4347-938c-1b4f34f82c4e-kube-api-access-mb6rf\") pod \"barbican-operator-controller-manager-658c7b459c-pwzgf\" (UID: \"e055f29e-803b-4347-938c-1b4f34f82c4e\") " pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:05.221837 master-0 kubenswrapper[4807]: I1014 13:33:05.221764 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb6rf\" (UniqueName: \"kubernetes.io/projected/e055f29e-803b-4347-938c-1b4f34f82c4e-kube-api-access-mb6rf\") pod \"barbican-operator-controller-manager-658c7b459c-pwzgf\" (UID: \"e055f29e-803b-4347-938c-1b4f34f82c4e\") " pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:05.231764 master-0 kubenswrapper[4807]: I1014 13:33:05.231696 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp"] Oct 14 13:33:05.232673 master-0 kubenswrapper[4807]: I1014 13:33:05.232640 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:05.254911 master-0 kubenswrapper[4807]: I1014 13:33:05.254793 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp"] Oct 14 13:33:05.271725 master-0 kubenswrapper[4807]: I1014 13:33:05.271649 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpm2n\" (UniqueName: \"kubernetes.io/projected/212aebfc-4a3c-4fa5-80c2-a8839f3b4f86-kube-api-access-bpm2n\") pod \"heat-operator-controller-manager-68fc865f87-c8wmp\" (UID: \"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86\") " pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:05.298512 master-0 kubenswrapper[4807]: I1014 13:33:05.296556 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt"] Oct 14 13:33:05.298512 master-0 kubenswrapper[4807]: I1014 13:33:05.297948 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:05.310397 master-0 kubenswrapper[4807]: I1014 13:33:05.310341 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt"] Oct 14 13:33:05.328961 master-0 kubenswrapper[4807]: I1014 13:33:05.328905 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:05.373599 master-0 kubenswrapper[4807]: I1014 13:33:05.373512 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bpm2n\" (UniqueName: \"kubernetes.io/projected/212aebfc-4a3c-4fa5-80c2-a8839f3b4f86-kube-api-access-bpm2n\") pod \"heat-operator-controller-manager-68fc865f87-c8wmp\" (UID: \"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86\") " pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:05.373599 master-0 kubenswrapper[4807]: I1014 13:33:05.373595 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8j6q\" (UniqueName: \"kubernetes.io/projected/e7f09943-10ca-48ff-b4a1-d3a45eca8b84-kube-api-access-w8j6q\") pod \"horizon-operator-controller-manager-54969ff695-hgxjt\" (UID: \"e7f09943-10ca-48ff-b4a1-d3a45eca8b84\") " pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:05.431596 master-0 kubenswrapper[4807]: I1014 13:33:05.431518 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpm2n\" (UniqueName: \"kubernetes.io/projected/212aebfc-4a3c-4fa5-80c2-a8839f3b4f86-kube-api-access-bpm2n\") pod \"heat-operator-controller-manager-68fc865f87-c8wmp\" (UID: \"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86\") " pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:05.433647 master-0 kubenswrapper[4807]: I1014 13:33:05.433570 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb"] Oct 14 13:33:05.434958 master-0 kubenswrapper[4807]: I1014 13:33:05.434922 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:05.475150 master-0 kubenswrapper[4807]: I1014 13:33:05.475086 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-w8j6q\" (UniqueName: \"kubernetes.io/projected/e7f09943-10ca-48ff-b4a1-d3a45eca8b84-kube-api-access-w8j6q\") pod \"horizon-operator-controller-manager-54969ff695-hgxjt\" (UID: \"e7f09943-10ca-48ff-b4a1-d3a45eca8b84\") " pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:05.475259 master-0 kubenswrapper[4807]: I1014 13:33:05.475162 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm8pw\" (UniqueName: \"kubernetes.io/projected/92830eea-03c2-4ccc-a331-5531e3cdd1eb-kube-api-access-tm8pw\") pod \"mariadb-operator-controller-manager-7f4856d67b-sgjwb\" (UID: \"92830eea-03c2-4ccc-a331-5531e3cdd1eb\") " pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:05.482504 master-0 kubenswrapper[4807]: I1014 13:33:05.482435 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb"] Oct 14 13:33:05.526516 master-0 kubenswrapper[4807]: I1014 13:33:05.526324 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb"] Oct 14 13:33:05.528092 master-0 kubenswrapper[4807]: I1014 13:33:05.528045 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:05.532674 master-0 kubenswrapper[4807]: I1014 13:33:05.532625 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8j6q\" (UniqueName: \"kubernetes.io/projected/e7f09943-10ca-48ff-b4a1-d3a45eca8b84-kube-api-access-w8j6q\") pod \"horizon-operator-controller-manager-54969ff695-hgxjt\" (UID: \"e7f09943-10ca-48ff-b4a1-d3a45eca8b84\") " pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:05.552948 master-0 kubenswrapper[4807]: I1014 13:33:05.552876 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb"] Oct 14 13:33:05.555915 master-0 kubenswrapper[4807]: I1014 13:33:05.555862 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:05.569650 master-0 kubenswrapper[4807]: I1014 13:33:05.569590 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph"] Oct 14 13:33:05.572398 master-0 kubenswrapper[4807]: I1014 13:33:05.572369 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:05.576628 master-0 kubenswrapper[4807]: I1014 13:33:05.576563 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kv9d\" (UniqueName: \"kubernetes.io/projected/f641b5d2-d16e-4671-b33e-6f6fdb84d178-kube-api-access-2kv9d\") pod \"octavia-operator-controller-manager-f456fb6cd-nb6ph\" (UID: \"f641b5d2-d16e-4671-b33e-6f6fdb84d178\") " pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:05.576628 master-0 kubenswrapper[4807]: I1014 13:33:05.576654 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tm8pw\" (UniqueName: \"kubernetes.io/projected/92830eea-03c2-4ccc-a331-5531e3cdd1eb-kube-api-access-tm8pw\") pod \"mariadb-operator-controller-manager-7f4856d67b-sgjwb\" (UID: \"92830eea-03c2-4ccc-a331-5531e3cdd1eb\") " pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:05.578049 master-0 kubenswrapper[4807]: I1014 13:33:05.576683 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hxz6\" (UniqueName: \"kubernetes.io/projected/9386645b-2c48-4674-824c-f62c6e27175c-kube-api-access-9hxz6\") pod \"nova-operator-controller-manager-64487ccd4d-8gqsb\" (UID: \"9386645b-2c48-4674-824c-f62c6e27175c\") " pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:05.604063 master-0 kubenswrapper[4807]: I1014 13:33:05.604001 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph"] Oct 14 13:33:05.622548 master-0 kubenswrapper[4807]: I1014 13:33:05.618679 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm8pw\" (UniqueName: \"kubernetes.io/projected/92830eea-03c2-4ccc-a331-5531e3cdd1eb-kube-api-access-tm8pw\") pod \"mariadb-operator-controller-manager-7f4856d67b-sgjwb\" (UID: \"92830eea-03c2-4ccc-a331-5531e3cdd1eb\") " pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:05.640858 master-0 kubenswrapper[4807]: I1014 13:33:05.640540 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:05.678487 master-0 kubenswrapper[4807]: I1014 13:33:05.678415 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2kv9d\" (UniqueName: \"kubernetes.io/projected/f641b5d2-d16e-4671-b33e-6f6fdb84d178-kube-api-access-2kv9d\") pod \"octavia-operator-controller-manager-f456fb6cd-nb6ph\" (UID: \"f641b5d2-d16e-4671-b33e-6f6fdb84d178\") " pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:05.678487 master-0 kubenswrapper[4807]: I1014 13:33:05.678499 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9hxz6\" (UniqueName: \"kubernetes.io/projected/9386645b-2c48-4674-824c-f62c6e27175c-kube-api-access-9hxz6\") pod \"nova-operator-controller-manager-64487ccd4d-8gqsb\" (UID: \"9386645b-2c48-4674-824c-f62c6e27175c\") " pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:05.726885 master-0 kubenswrapper[4807]: I1014 13:33:05.726662 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hxz6\" (UniqueName: \"kubernetes.io/projected/9386645b-2c48-4674-824c-f62c6e27175c-kube-api-access-9hxz6\") pod \"nova-operator-controller-manager-64487ccd4d-8gqsb\" (UID: \"9386645b-2c48-4674-824c-f62c6e27175c\") " pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:05.734050 master-0 kubenswrapper[4807]: I1014 13:33:05.733618 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kv9d\" (UniqueName: \"kubernetes.io/projected/f641b5d2-d16e-4671-b33e-6f6fdb84d178-kube-api-access-2kv9d\") pod \"octavia-operator-controller-manager-f456fb6cd-nb6ph\" (UID: \"f641b5d2-d16e-4671-b33e-6f6fdb84d178\") " pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:05.748793 master-0 kubenswrapper[4807]: I1014 13:33:05.747932 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8"] Oct 14 13:33:05.755366 master-0 kubenswrapper[4807]: I1014 13:33:05.754640 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:05.795496 master-0 kubenswrapper[4807]: I1014 13:33:05.792931 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:05.796951 master-0 kubenswrapper[4807]: I1014 13:33:05.796901 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8"] Oct 14 13:33:05.803792 master-0 kubenswrapper[4807]: I1014 13:33:05.803620 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8"] Oct 14 13:33:05.805914 master-0 kubenswrapper[4807]: I1014 13:33:05.805872 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:05.810160 master-0 kubenswrapper[4807]: I1014 13:33:05.810100 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8"] Oct 14 13:33:05.832162 master-0 kubenswrapper[4807]: W1014 13:33:05.832090 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode055f29e_803b_4347_938c_1b4f34f82c4e.slice/crio-4c9408c612bc5f85ddcb232fa62d7bbc504f77420ab31bc72751035413a93a8d WatchSource:0}: Error finding container 4c9408c612bc5f85ddcb232fa62d7bbc504f77420ab31bc72751035413a93a8d: Status 404 returned error can't find the container with id 4c9408c612bc5f85ddcb232fa62d7bbc504f77420ab31bc72751035413a93a8d Oct 14 13:33:05.878087 master-0 kubenswrapper[4807]: I1014 13:33:05.877850 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf"] Oct 14 13:33:05.884212 master-0 kubenswrapper[4807]: I1014 13:33:05.883079 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:05.884212 master-0 kubenswrapper[4807]: I1014 13:33:05.883257 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rnbr\" (UniqueName: \"kubernetes.io/projected/a11cda58-2025-4306-a8a1-a43b73d81406-kube-api-access-8rnbr\") pod \"swift-operator-controller-manager-6d4f9d7767-dj7p8\" (UID: \"a11cda58-2025-4306-a8a1-a43b73d81406\") " pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:05.914436 master-0 kubenswrapper[4807]: I1014 13:33:05.913818 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:05.989634 master-0 kubenswrapper[4807]: I1014 13:33:05.986099 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqmr4\" (UniqueName: \"kubernetes.io/projected/67bc6bf3-8aca-494e-ad59-85ded9a22350-kube-api-access-kqmr4\") pod \"telemetry-operator-controller-manager-7585684bd7-5wlc8\" (UID: \"67bc6bf3-8aca-494e-ad59-85ded9a22350\") " pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:05.989634 master-0 kubenswrapper[4807]: I1014 13:33:05.986172 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8rnbr\" (UniqueName: \"kubernetes.io/projected/a11cda58-2025-4306-a8a1-a43b73d81406-kube-api-access-8rnbr\") pod \"swift-operator-controller-manager-6d4f9d7767-dj7p8\" (UID: \"a11cda58-2025-4306-a8a1-a43b73d81406\") " pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:06.026730 master-0 kubenswrapper[4807]: I1014 13:33:06.025393 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp"] Oct 14 13:33:06.030961 master-0 kubenswrapper[4807]: I1014 13:33:06.030530 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rnbr\" (UniqueName: \"kubernetes.io/projected/a11cda58-2025-4306-a8a1-a43b73d81406-kube-api-access-8rnbr\") pod \"swift-operator-controller-manager-6d4f9d7767-dj7p8\" (UID: \"a11cda58-2025-4306-a8a1-a43b73d81406\") " pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:06.038545 master-0 kubenswrapper[4807]: W1014 13:33:06.036174 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212aebfc_4a3c_4fa5_80c2_a8839f3b4f86.slice/crio-0cba10ecb4f7df492ee5f2080aeea12f8814969f58e0f2bd64c1fb03c0a09060 WatchSource:0}: Error finding container 0cba10ecb4f7df492ee5f2080aeea12f8814969f58e0f2bd64c1fb03c0a09060: Status 404 returned error can't find the container with id 0cba10ecb4f7df492ee5f2080aeea12f8814969f58e0f2bd64c1fb03c0a09060 Oct 14 13:33:06.090887 master-0 kubenswrapper[4807]: I1014 13:33:06.090348 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kqmr4\" (UniqueName: \"kubernetes.io/projected/67bc6bf3-8aca-494e-ad59-85ded9a22350-kube-api-access-kqmr4\") pod \"telemetry-operator-controller-manager-7585684bd7-5wlc8\" (UID: \"67bc6bf3-8aca-494e-ad59-85ded9a22350\") " pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:06.096289 master-0 kubenswrapper[4807]: I1014 13:33:06.096201 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:06.130493 master-0 kubenswrapper[4807]: I1014 13:33:06.130410 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqmr4\" (UniqueName: \"kubernetes.io/projected/67bc6bf3-8aca-494e-ad59-85ded9a22350-kube-api-access-kqmr4\") pod \"telemetry-operator-controller-manager-7585684bd7-5wlc8\" (UID: \"67bc6bf3-8aca-494e-ad59-85ded9a22350\") " pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:06.140093 master-0 kubenswrapper[4807]: I1014 13:33:06.139996 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:06.161237 master-0 kubenswrapper[4807]: I1014 13:33:06.160920 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt"] Oct 14 13:33:06.305480 master-0 kubenswrapper[4807]: I1014 13:33:06.298928 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb"] Oct 14 13:33:06.387645 master-0 kubenswrapper[4807]: I1014 13:33:06.386077 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph"] Oct 14 13:33:06.483570 master-0 kubenswrapper[4807]: I1014 13:33:06.483510 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb"] Oct 14 13:33:06.518607 master-0 kubenswrapper[4807]: I1014 13:33:06.518534 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" event={"ID":"92830eea-03c2-4ccc-a331-5531e3cdd1eb","Type":"ContainerStarted","Data":"086a80421e1c7c6e8d743a48febc6811e7b662e195b600be7d46ab16c4bbc2a0"} Oct 14 13:33:06.520144 master-0 kubenswrapper[4807]: I1014 13:33:06.520126 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" event={"ID":"f641b5d2-d16e-4671-b33e-6f6fdb84d178","Type":"ContainerStarted","Data":"a08b3fc8f098c6f78a39429170ea649dddc0586d554f38287016d3f149bc9e41"} Oct 14 13:33:06.522908 master-0 kubenswrapper[4807]: I1014 13:33:06.522891 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" event={"ID":"e7f09943-10ca-48ff-b4a1-d3a45eca8b84","Type":"ContainerStarted","Data":"048fddb88a55599e881a2cbbfe493f8a7316054bd5208ae2df550b818d8e7211"} Oct 14 13:33:06.524174 master-0 kubenswrapper[4807]: I1014 13:33:06.524147 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" event={"ID":"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86","Type":"ContainerStarted","Data":"0cba10ecb4f7df492ee5f2080aeea12f8814969f58e0f2bd64c1fb03c0a09060"} Oct 14 13:33:06.526275 master-0 kubenswrapper[4807]: I1014 13:33:06.526253 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" event={"ID":"e055f29e-803b-4347-938c-1b4f34f82c4e","Type":"ContainerStarted","Data":"4c9408c612bc5f85ddcb232fa62d7bbc504f77420ab31bc72751035413a93a8d"} Oct 14 13:33:06.527763 master-0 kubenswrapper[4807]: I1014 13:33:06.527677 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" event={"ID":"9386645b-2c48-4674-824c-f62c6e27175c","Type":"ContainerStarted","Data":"8328d671a73c65bcfd7fa41c4af6cd309134834b89d5775aec1c0683ebdc0063"} Oct 14 13:33:06.581165 master-0 kubenswrapper[4807]: I1014 13:33:06.581114 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8"] Oct 14 13:33:06.584237 master-0 kubenswrapper[4807]: W1014 13:33:06.584206 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda11cda58_2025_4306_a8a1_a43b73d81406.slice/crio-a49b5d2506bb7611b58a524bdf1092145d992b17da2bc0add564a178a31939cf WatchSource:0}: Error finding container a49b5d2506bb7611b58a524bdf1092145d992b17da2bc0add564a178a31939cf: Status 404 returned error can't find the container with id a49b5d2506bb7611b58a524bdf1092145d992b17da2bc0add564a178a31939cf Oct 14 13:33:06.666571 master-0 kubenswrapper[4807]: I1014 13:33:06.666442 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8"] Oct 14 13:33:06.679238 master-0 kubenswrapper[4807]: W1014 13:33:06.679180 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bc6bf3_8aca_494e_ad59_85ded9a22350.slice/crio-74603b645b21964cee5f3769c33dd44c79511adee71fd241f3829ddd91d84c27 WatchSource:0}: Error finding container 74603b645b21964cee5f3769c33dd44c79511adee71fd241f3829ddd91d84c27: Status 404 returned error can't find the container with id 74603b645b21964cee5f3769c33dd44c79511adee71fd241f3829ddd91d84c27 Oct 14 13:33:07.538471 master-0 kubenswrapper[4807]: I1014 13:33:07.538397 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" event={"ID":"a11cda58-2025-4306-a8a1-a43b73d81406","Type":"ContainerStarted","Data":"a49b5d2506bb7611b58a524bdf1092145d992b17da2bc0add564a178a31939cf"} Oct 14 13:33:07.539689 master-0 kubenswrapper[4807]: I1014 13:33:07.539660 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" event={"ID":"67bc6bf3-8aca-494e-ad59-85ded9a22350","Type":"ContainerStarted","Data":"74603b645b21964cee5f3769c33dd44c79511adee71fd241f3829ddd91d84c27"} Oct 14 13:33:11.585770 master-0 kubenswrapper[4807]: I1014 13:33:11.577881 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" event={"ID":"a11cda58-2025-4306-a8a1-a43b73d81406","Type":"ContainerStarted","Data":"d192ede050f156b5de0685c7224952e652dfcb09a39f8eef10d9671f843e4d53"} Oct 14 13:33:11.596669 master-0 kubenswrapper[4807]: I1014 13:33:11.592466 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" event={"ID":"e7f09943-10ca-48ff-b4a1-d3a45eca8b84","Type":"ContainerStarted","Data":"113fdbea5255d8ca060c17de26ac20885d0d66c6c8c58b99ec8431d3ed94f84a"} Oct 14 13:33:11.613506 master-0 kubenswrapper[4807]: I1014 13:33:11.609315 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" event={"ID":"67bc6bf3-8aca-494e-ad59-85ded9a22350","Type":"ContainerStarted","Data":"72a16767cf95ab7c4a8b70b4f0fa9c54b97e9ce9f5891151dd88079bc3f70a4d"} Oct 14 13:33:11.643490 master-0 kubenswrapper[4807]: I1014 13:33:11.635774 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" event={"ID":"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86","Type":"ContainerStarted","Data":"246e1254c511f0698c8c78db944c14601aa5129edf5a1bedc1d6670bef6e848d"} Oct 14 13:33:11.643490 master-0 kubenswrapper[4807]: I1014 13:33:11.635838 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" event={"ID":"212aebfc-4a3c-4fa5-80c2-a8839f3b4f86","Type":"ContainerStarted","Data":"490e2bb147f1d5ab4d6ec98e1cea01e8281fb1c5528a599810b320a558e49fec"} Oct 14 13:33:11.643490 master-0 kubenswrapper[4807]: I1014 13:33:11.636601 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:11.670209 master-0 kubenswrapper[4807]: I1014 13:33:11.670146 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" event={"ID":"e055f29e-803b-4347-938c-1b4f34f82c4e","Type":"ContainerStarted","Data":"07586af8a701643ab010596eb984bf9d16e0146697a85d9a385da2fe90797e49"} Oct 14 13:33:11.671308 master-0 kubenswrapper[4807]: I1014 13:33:11.671285 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:11.685509 master-0 kubenswrapper[4807]: I1014 13:33:11.681845 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" event={"ID":"9386645b-2c48-4674-824c-f62c6e27175c","Type":"ContainerStarted","Data":"5871205f2217a0478aa371071ba018eb85b54332be5efc0cae8ee91328e5df45"} Oct 14 13:33:11.685509 master-0 kubenswrapper[4807]: I1014 13:33:11.681882 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" event={"ID":"9386645b-2c48-4674-824c-f62c6e27175c","Type":"ContainerStarted","Data":"a1e20ef59f3b60b60060203010fa16a0e96e6c88b8b501501a73b6471a07c394"} Oct 14 13:33:11.685509 master-0 kubenswrapper[4807]: I1014 13:33:11.682380 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:11.699504 master-0 kubenswrapper[4807]: I1014 13:33:11.699427 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" event={"ID":"92830eea-03c2-4ccc-a331-5531e3cdd1eb","Type":"ContainerStarted","Data":"89b9d27bb14c4e41a8003fee6631303920c33adbccc93144c55ee38743c610ee"} Oct 14 13:33:11.699504 master-0 kubenswrapper[4807]: I1014 13:33:11.699497 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" event={"ID":"92830eea-03c2-4ccc-a331-5531e3cdd1eb","Type":"ContainerStarted","Data":"58b783c31400694a107e20f23554c509bf5b2077e4f365dbc76bb43b96ec23d0"} Oct 14 13:33:11.700909 master-0 kubenswrapper[4807]: I1014 13:33:11.700345 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:11.719501 master-0 kubenswrapper[4807]: I1014 13:33:11.718808 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" event={"ID":"f641b5d2-d16e-4671-b33e-6f6fdb84d178","Type":"ContainerStarted","Data":"ca9bd5ad64c083f46b1c177199fe998b24f49b4dc707c642caa2852524208db9"} Oct 14 13:33:11.719501 master-0 kubenswrapper[4807]: I1014 13:33:11.718895 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" event={"ID":"f641b5d2-d16e-4671-b33e-6f6fdb84d178","Type":"ContainerStarted","Data":"802ee4a6f58765fdc6542f1b7417f6ec949fc4ebd0c8b708fd9951a3ea64450d"} Oct 14 13:33:11.719501 master-0 kubenswrapper[4807]: I1014 13:33:11.719034 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" podStartSLOduration=1.879586387 podStartE2EDuration="6.719013641s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.04251281 +0000 UTC m=+780.723814634" lastFinishedPulling="2025-10-14 13:33:10.881940064 +0000 UTC m=+785.563241888" observedRunningTime="2025-10-14 13:33:11.663354273 +0000 UTC m=+786.344656097" watchObservedRunningTime="2025-10-14 13:33:11.719013641 +0000 UTC m=+786.400315465" Oct 14 13:33:11.723490 master-0 kubenswrapper[4807]: I1014 13:33:11.719871 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:11.723490 master-0 kubenswrapper[4807]: I1014 13:33:11.720386 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" podStartSLOduration=2.692258031 podStartE2EDuration="7.72037634s" podCreationTimestamp="2025-10-14 13:33:04 +0000 UTC" firstStartedPulling="2025-10-14 13:33:05.852592681 +0000 UTC m=+780.533894505" lastFinishedPulling="2025-10-14 13:33:10.88071097 +0000 UTC m=+785.562012814" observedRunningTime="2025-10-14 13:33:11.71685423 +0000 UTC m=+786.398156054" watchObservedRunningTime="2025-10-14 13:33:11.72037634 +0000 UTC m=+786.401678164" Oct 14 13:33:11.778843 master-0 kubenswrapper[4807]: I1014 13:33:11.778150 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" podStartSLOduration=2.210330072 podStartE2EDuration="6.778130466s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.309549881 +0000 UTC m=+780.990851705" lastFinishedPulling="2025-10-14 13:33:10.877350275 +0000 UTC m=+785.558652099" observedRunningTime="2025-10-14 13:33:11.745732454 +0000 UTC m=+786.427034278" watchObservedRunningTime="2025-10-14 13:33:11.778130466 +0000 UTC m=+786.459432290" Oct 14 13:33:11.780218 master-0 kubenswrapper[4807]: I1014 13:33:11.779893 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" podStartSLOduration=2.356666225 podStartE2EDuration="6.779883866s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.492901306 +0000 UTC m=+781.174203130" lastFinishedPulling="2025-10-14 13:33:10.916118947 +0000 UTC m=+785.597420771" observedRunningTime="2025-10-14 13:33:11.777736995 +0000 UTC m=+786.459038819" watchObservedRunningTime="2025-10-14 13:33:11.779883866 +0000 UTC m=+786.461185710" Oct 14 13:33:11.814533 master-0 kubenswrapper[4807]: I1014 13:33:11.814409 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" podStartSLOduration=2.301231862 podStartE2EDuration="6.814379437s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.407357566 +0000 UTC m=+781.088659390" lastFinishedPulling="2025-10-14 13:33:10.920505141 +0000 UTC m=+785.601806965" observedRunningTime="2025-10-14 13:33:11.812381181 +0000 UTC m=+786.493683005" watchObservedRunningTime="2025-10-14 13:33:11.814379437 +0000 UTC m=+786.495681261" Oct 14 13:33:12.730130 master-0 kubenswrapper[4807]: I1014 13:33:12.730020 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" event={"ID":"a11cda58-2025-4306-a8a1-a43b73d81406","Type":"ContainerStarted","Data":"d5595e29a9be313fc7d02b9fc80683551f8e3fddb7a93e754b90271047f4d4c1"} Oct 14 13:33:12.730908 master-0 kubenswrapper[4807]: I1014 13:33:12.730239 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:12.732647 master-0 kubenswrapper[4807]: I1014 13:33:12.732609 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" event={"ID":"e7f09943-10ca-48ff-b4a1-d3a45eca8b84","Type":"ContainerStarted","Data":"55d80b0b84ffb32534ad515158435fdec1a7ebf9ca7da273a39fce3effec8461"} Oct 14 13:33:12.732890 master-0 kubenswrapper[4807]: I1014 13:33:12.732822 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:12.735952 master-0 kubenswrapper[4807]: I1014 13:33:12.735897 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" event={"ID":"67bc6bf3-8aca-494e-ad59-85ded9a22350","Type":"ContainerStarted","Data":"2f0de27ff164708a6b30f1f57383348503538241cec2839414c0600d3ddb854a"} Oct 14 13:33:12.738173 master-0 kubenswrapper[4807]: I1014 13:33:12.738126 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" event={"ID":"e055f29e-803b-4347-938c-1b4f34f82c4e","Type":"ContainerStarted","Data":"4fbaa6cc68fb0b2ada8cc82cc73c5612b86b447f1bc9643b771d19abac81a4f8"} Oct 14 13:33:12.772503 master-0 kubenswrapper[4807]: I1014 13:33:12.762522 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" podStartSLOduration=3.416856136 podStartE2EDuration="7.762489862s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.58679686 +0000 UTC m=+781.268098684" lastFinishedPulling="2025-10-14 13:33:10.932430586 +0000 UTC m=+785.613732410" observedRunningTime="2025-10-14 13:33:12.759453226 +0000 UTC m=+787.440755070" watchObservedRunningTime="2025-10-14 13:33:12.762489862 +0000 UTC m=+787.443791696" Oct 14 13:33:12.849580 master-0 kubenswrapper[4807]: I1014 13:33:12.849491 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" podStartSLOduration=3.656775344 podStartE2EDuration="7.849444601s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.683951177 +0000 UTC m=+781.365253001" lastFinishedPulling="2025-10-14 13:33:10.876620414 +0000 UTC m=+785.557922258" observedRunningTime="2025-10-14 13:33:12.798315151 +0000 UTC m=+787.479617015" watchObservedRunningTime="2025-10-14 13:33:12.849444601 +0000 UTC m=+787.530746425" Oct 14 13:33:12.850534 master-0 kubenswrapper[4807]: I1014 13:33:12.850447 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" podStartSLOduration=3.130695616 podStartE2EDuration="7.850437269s" podCreationTimestamp="2025-10-14 13:33:05 +0000 UTC" firstStartedPulling="2025-10-14 13:33:06.196417585 +0000 UTC m=+780.877719409" lastFinishedPulling="2025-10-14 13:33:10.916159238 +0000 UTC m=+785.597461062" observedRunningTime="2025-10-14 13:33:12.847390283 +0000 UTC m=+787.528692127" watchObservedRunningTime="2025-10-14 13:33:12.850437269 +0000 UTC m=+787.531739093" Oct 14 13:33:13.747171 master-0 kubenswrapper[4807]: I1014 13:33:13.747109 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:16.100339 master-0 kubenswrapper[4807]: I1014 13:33:16.100247 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/swift-operator-controller-manager-6d4f9d7767-dj7p8" Oct 14 13:33:16.144229 master-0 kubenswrapper[4807]: I1014 13:33:16.144136 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/telemetry-operator-controller-manager-7585684bd7-5wlc8" Oct 14 13:33:25.335500 master-0 kubenswrapper[4807]: I1014 13:33:25.335378 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/barbican-operator-controller-manager-658c7b459c-pwzgf" Oct 14 13:33:25.559491 master-0 kubenswrapper[4807]: I1014 13:33:25.559361 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/heat-operator-controller-manager-68fc865f87-c8wmp" Oct 14 13:33:25.647543 master-0 kubenswrapper[4807]: I1014 13:33:25.646892 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/horizon-operator-controller-manager-54969ff695-hgxjt" Oct 14 13:33:25.796600 master-0 kubenswrapper[4807]: I1014 13:33:25.796526 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/mariadb-operator-controller-manager-7f4856d67b-sgjwb" Oct 14 13:33:25.886880 master-0 kubenswrapper[4807]: I1014 13:33:25.886795 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/nova-operator-controller-manager-64487ccd4d-8gqsb" Oct 14 13:33:25.917644 master-0 kubenswrapper[4807]: I1014 13:33:25.917511 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack-operators/octavia-operator-controller-manager-f456fb6cd-nb6ph" Oct 14 13:33:47.007623 master-0 kubenswrapper[4807]: I1014 13:33:47.007548 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-kube-apiserver/revision-pruner-6-master-0"] Oct 14 13:33:47.008638 master-0 kubenswrapper[4807]: I1014 13:33:47.008599 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.011551 master-0 kubenswrapper[4807]: I1014 13:33:47.011428 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openshift-kube-apiserver"/"installer-sa-dockercfg-p7d8w" Oct 14 13:33:47.019662 master-0 kubenswrapper[4807]: I1014 13:33:47.019604 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-6-master-0"] Oct 14 13:33:47.160652 master-0 kubenswrapper[4807]: I1014 13:33:47.160566 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.160652 master-0 kubenswrapper[4807]: I1014 13:33:47.160643 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.262769 master-0 kubenswrapper[4807]: I1014 13:33:47.262567 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.262769 master-0 kubenswrapper[4807]: I1014 13:33:47.262682 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.263095 master-0 kubenswrapper[4807]: I1014 13:33:47.262837 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.296826 master-0 kubenswrapper[4807]: I1014 13:33:47.296743 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access\") pod \"revision-pruner-6-master-0\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.327086 master-0 kubenswrapper[4807]: I1014 13:33:47.326994 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:47.796666 master-0 kubenswrapper[4807]: I1014 13:33:47.792969 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-kube-apiserver/revision-pruner-6-master-0"] Oct 14 13:33:48.060348 master-0 kubenswrapper[4807]: I1014 13:33:48.060086 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-6-master-0" event={"ID":"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7","Type":"ContainerStarted","Data":"5b3a89b31bcfa68e0e0c01f099d055b04e30c0fe07643ca221efd41c6118d3cc"} Oct 14 13:33:49.070932 master-0 kubenswrapper[4807]: I1014 13:33:49.070874 4807 generic.go:334] "Generic (PLEG): container finished" podID="6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" containerID="08d17ccaa6c75b930673ca075ca09d1da11d4e411f7a7a0aad1f974cbc04d3e6" exitCode=0 Oct 14 13:33:49.071253 master-0 kubenswrapper[4807]: I1014 13:33:49.070940 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-6-master-0" event={"ID":"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7","Type":"ContainerDied","Data":"08d17ccaa6c75b930673ca075ca09d1da11d4e411f7a7a0aad1f974cbc04d3e6"} Oct 14 13:33:50.407165 master-0 kubenswrapper[4807]: I1014 13:33:50.407017 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:33:50.476332 master-0 kubenswrapper[4807]: I1014 13:33:50.476266 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir\") pod \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " Oct 14 13:33:50.476627 master-0 kubenswrapper[4807]: I1014 13:33:50.476354 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access\") pod \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\" (UID: \"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7\") " Oct 14 13:33:50.476627 master-0 kubenswrapper[4807]: I1014 13:33:50.476409 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir" (OuterVolumeSpecName: "kubelet-dir") pod "6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" (UID: "6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7"). InnerVolumeSpecName "kubelet-dir". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:33:50.476853 master-0 kubenswrapper[4807]: I1014 13:33:50.476823 4807 reconciler_common.go:293] "Volume detached for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kubelet-dir\") on node \"master-0\" DevicePath \"\"" Oct 14 13:33:50.482216 master-0 kubenswrapper[4807]: I1014 13:33:50.482148 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access" (OuterVolumeSpecName: "kube-api-access") pod "6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" (UID: "6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7"). InnerVolumeSpecName "kube-api-access". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:33:50.577820 master-0 kubenswrapper[4807]: I1014 13:33:50.577739 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access\" (UniqueName: \"kubernetes.io/projected/6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7-kube-api-access\") on node \"master-0\" DevicePath \"\"" Oct 14 13:33:51.086985 master-0 kubenswrapper[4807]: I1014 13:33:51.086891 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-kube-apiserver/revision-pruner-6-master-0" event={"ID":"6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7","Type":"ContainerDied","Data":"5b3a89b31bcfa68e0e0c01f099d055b04e30c0fe07643ca221efd41c6118d3cc"} Oct 14 13:33:51.086985 master-0 kubenswrapper[4807]: I1014 13:33:51.086956 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b3a89b31bcfa68e0e0c01f099d055b04e30c0fe07643ca221efd41c6118d3cc" Oct 14 13:33:51.087456 master-0 kubenswrapper[4807]: I1014 13:33:51.087009 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-kube-apiserver/revision-pruner-6-master-0" Oct 14 13:34:08.965524 master-0 kubenswrapper[4807]: I1014 13:34:08.965400 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:08.966177 master-0 kubenswrapper[4807]: E1014 13:34:08.965858 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" containerName="pruner" Oct 14 13:34:08.966177 master-0 kubenswrapper[4807]: I1014 13:34:08.965878 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" containerName="pruner" Oct 14 13:34:08.966177 master-0 kubenswrapper[4807]: I1014 13:34:08.966001 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="6dcfa751-97d5-4f9e-a3ab-19ba1fd7f7b7" containerName="pruner" Oct 14 13:34:08.966945 master-0 kubenswrapper[4807]: I1014 13:34:08.966923 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:08.972580 master-0 kubenswrapper[4807]: I1014 13:34:08.971940 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:34:08.972580 master-0 kubenswrapper[4807]: I1014 13:34:08.972090 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"kube-root-ca.crt" Oct 14 13:34:08.974134 master-0 kubenswrapper[4807]: I1014 13:34:08.974096 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openshift-service-ca.crt" Oct 14 13:34:08.991074 master-0 kubenswrapper[4807]: I1014 13:34:08.991019 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:09.074143 master-0 kubenswrapper[4807]: I1014 13:34:09.074078 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.074418 master-0 kubenswrapper[4807]: I1014 13:34:09.074335 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dhlt\" (UniqueName: \"kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.175338 master-0 kubenswrapper[4807]: I1014 13:34:09.175268 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.175653 master-0 kubenswrapper[4807]: I1014 13:34:09.175379 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2dhlt\" (UniqueName: \"kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.176670 master-0 kubenswrapper[4807]: I1014 13:34:09.176634 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.212043 master-0 kubenswrapper[4807]: I1014 13:34:09.211963 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dhlt\" (UniqueName: \"kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt\") pod \"dnsmasq-dns-5bd48d54dc-7mjwq\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.330366 master-0 kubenswrapper[4807]: I1014 13:34:09.330136 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:09.766395 master-0 kubenswrapper[4807]: I1014 13:34:09.766138 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:09.769758 master-0 kubenswrapper[4807]: W1014 13:34:09.769713 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1bb42c7_3374_4ba3_bcce_e0098e15bbec.slice/crio-98d3ee32c7f127bc974895f74e820a9ee2fac87a236e32c960b335c79f6c60c4 WatchSource:0}: Error finding container 98d3ee32c7f127bc974895f74e820a9ee2fac87a236e32c960b335c79f6c60c4: Status 404 returned error can't find the container with id 98d3ee32c7f127bc974895f74e820a9ee2fac87a236e32c960b335c79f6c60c4 Oct 14 13:34:09.772533 master-0 kubenswrapper[4807]: I1014 13:34:09.772507 4807 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 14 13:34:10.252004 master-0 kubenswrapper[4807]: I1014 13:34:10.251930 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" event={"ID":"c1bb42c7-3374-4ba3-bcce-e0098e15bbec","Type":"ContainerStarted","Data":"98d3ee32c7f127bc974895f74e820a9ee2fac87a236e32c960b335c79f6c60c4"} Oct 14 13:34:11.106273 master-0 kubenswrapper[4807]: I1014 13:34:11.106175 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:11.159510 master-0 kubenswrapper[4807]: I1014 13:34:11.159347 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:11.163490 master-0 kubenswrapper[4807]: I1014 13:34:11.160945 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.166082 master-0 kubenswrapper[4807]: I1014 13:34:11.165722 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:34:11.176553 master-0 kubenswrapper[4807]: I1014 13:34:11.175443 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:11.311024 master-0 kubenswrapper[4807]: I1014 13:34:11.310937 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssvqm\" (UniqueName: \"kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.311024 master-0 kubenswrapper[4807]: I1014 13:34:11.311034 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.311703 master-0 kubenswrapper[4807]: I1014 13:34:11.311098 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.413283 master-0 kubenswrapper[4807]: I1014 13:34:11.413115 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.413283 master-0 kubenswrapper[4807]: I1014 13:34:11.413193 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.413283 master-0 kubenswrapper[4807]: I1014 13:34:11.413238 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ssvqm\" (UniqueName: \"kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.414278 master-0 kubenswrapper[4807]: I1014 13:34:11.414238 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.423023 master-0 kubenswrapper[4807]: I1014 13:34:11.422970 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.456636 master-0 kubenswrapper[4807]: I1014 13:34:11.456580 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssvqm\" (UniqueName: \"kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm\") pod \"dnsmasq-dns-697b8fd54f-zqxb9\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:11.491343 master-0 kubenswrapper[4807]: I1014 13:34:11.491260 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:12.025512 master-0 kubenswrapper[4807]: I1014 13:34:12.025374 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:12.040487 master-0 kubenswrapper[4807]: W1014 13:34:12.038192 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f55b727_642e_4fc0_bc2c_ed3dbb30fa86.slice/crio-f50ef2312fa2e563e4291a7c5c3ceb9dfb33f96293f48a2bff3e3d7acdccf9e0 WatchSource:0}: Error finding container f50ef2312fa2e563e4291a7c5c3ceb9dfb33f96293f48a2bff3e3d7acdccf9e0: Status 404 returned error can't find the container with id f50ef2312fa2e563e4291a7c5c3ceb9dfb33f96293f48a2bff3e3d7acdccf9e0 Oct 14 13:34:12.277514 master-0 kubenswrapper[4807]: I1014 13:34:12.277322 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" event={"ID":"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86","Type":"ContainerStarted","Data":"f50ef2312fa2e563e4291a7c5c3ceb9dfb33f96293f48a2bff3e3d7acdccf9e0"} Oct 14 13:34:15.433909 master-0 kubenswrapper[4807]: I1014 13:34:15.433811 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-server-0"] Oct 14 13:34:15.435223 master-0 kubenswrapper[4807]: I1014 13:34:15.435193 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.437531 master-0 kubenswrapper[4807]: I1014 13:34:15.437453 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-svc" Oct 14 13:34:15.437609 master-0 kubenswrapper[4807]: I1014 13:34:15.437543 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-erlang-cookie" Oct 14 13:34:15.437802 master-0 kubenswrapper[4807]: I1014 13:34:15.437758 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-server-conf" Oct 14 13:34:15.438037 master-0 kubenswrapper[4807]: I1014 13:34:15.438007 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-config-data" Oct 14 13:34:15.438090 master-0 kubenswrapper[4807]: I1014 13:34:15.438041 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-default-user" Oct 14 13:34:15.439272 master-0 kubenswrapper[4807]: I1014 13:34:15.439128 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-plugins-conf" Oct 14 13:34:15.448397 master-0 kubenswrapper[4807]: I1014 13:34:15.447301 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Oct 14 13:34:15.636961 master-0 kubenswrapper[4807]: I1014 13:34:15.636901 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637310 master-0 kubenswrapper[4807]: I1014 13:34:15.637286 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-69363d1d-a17b-41f9-a6f2-435f6a53e7c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^064fcb14-c5a2-4ea2-b49a-7130a675135c\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637441 master-0 kubenswrapper[4807]: I1014 13:34:15.637406 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637592 master-0 kubenswrapper[4807]: I1014 13:34:15.637575 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqrkh\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-kube-api-access-dqrkh\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637706 master-0 kubenswrapper[4807]: I1014 13:34:15.637693 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637826 master-0 kubenswrapper[4807]: I1014 13:34:15.637806 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.637972 master-0 kubenswrapper[4807]: I1014 13:34:15.637959 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.638070 master-0 kubenswrapper[4807]: I1014 13:34:15.638056 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.638147 master-0 kubenswrapper[4807]: I1014 13:34:15.638133 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.638272 master-0 kubenswrapper[4807]: I1014 13:34:15.638256 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.638450 master-0 kubenswrapper[4807]: I1014 13:34:15.638412 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740352 master-0 kubenswrapper[4807]: I1014 13:34:15.740219 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740352 master-0 kubenswrapper[4807]: I1014 13:34:15.740278 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740352 master-0 kubenswrapper[4807]: I1014 13:34:15.740313 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-69363d1d-a17b-41f9-a6f2-435f6a53e7c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^064fcb14-c5a2-4ea2-b49a-7130a675135c\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740352 master-0 kubenswrapper[4807]: I1014 13:34:15.740336 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740374 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dqrkh\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-kube-api-access-dqrkh\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740393 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740427 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740470 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740500 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740523 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.740686 master-0 kubenswrapper[4807]: I1014 13:34:15.740546 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.743080 master-0 kubenswrapper[4807]: I1014 13:34:15.741932 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-plugins\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.743080 master-0 kubenswrapper[4807]: I1014 13:34:15.742340 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-plugins-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.743080 master-0 kubenswrapper[4807]: I1014 13:34:15.742364 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-erlang-cookie\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.743212 master-0 kubenswrapper[4807]: I1014 13:34:15.743109 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-config-data\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.743917 master-0 kubenswrapper[4807]: I1014 13:34:15.743851 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-server-conf\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.744677 master-0 kubenswrapper[4807]: I1014 13:34:15.744653 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-confd\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.745535 master-0 kubenswrapper[4807]: I1014 13:34:15.745355 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:15.745535 master-0 kubenswrapper[4807]: I1014 13:34:15.745387 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-69363d1d-a17b-41f9-a6f2-435f6a53e7c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^064fcb14-c5a2-4ea2-b49a-7130a675135c\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/c3c8f47a65caa3a5c19e7847a1894ba130d3db1a7a30c5fee42c838e08d46383/globalmount\"" pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.748751 master-0 kubenswrapper[4807]: I1014 13:34:15.748453 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-pod-info\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.748751 master-0 kubenswrapper[4807]: I1014 13:34:15.748705 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-erlang-cookie-secret\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.749774 master-0 kubenswrapper[4807]: I1014 13:34:15.749744 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-rabbitmq-tls\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:15.783165 master-0 kubenswrapper[4807]: I1014 13:34:15.783111 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqrkh\" (UniqueName: \"kubernetes.io/projected/6b34cbbc-c394-4369-9ee0-db4e899c4bbf-kube-api-access-dqrkh\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:16.643801 master-0 kubenswrapper[4807]: I1014 13:34:16.643732 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/memcached-0"] Oct 14 13:34:16.644741 master-0 kubenswrapper[4807]: I1014 13:34:16.644707 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Oct 14 13:34:16.647864 master-0 kubenswrapper[4807]: I1014 13:34:16.647835 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-memcached-svc" Oct 14 13:34:16.648111 master-0 kubenswrapper[4807]: I1014 13:34:16.648065 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"memcached-config-data" Oct 14 13:34:16.654108 master-0 kubenswrapper[4807]: I1014 13:34:16.654057 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"combined-ca-bundle" Oct 14 13:34:16.665015 master-0 kubenswrapper[4807]: I1014 13:34:16.664958 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Oct 14 13:34:16.760862 master-0 kubenswrapper[4807]: I1014 13:34:16.760800 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfbgv\" (UniqueName: \"kubernetes.io/projected/27eaf28f-44fc-464e-9901-4914959a1648-kube-api-access-cfbgv\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.761331 master-0 kubenswrapper[4807]: I1014 13:34:16.761310 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.761511 master-0 kubenswrapper[4807]: I1014 13:34:16.761495 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-config-data\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.761635 master-0 kubenswrapper[4807]: I1014 13:34:16.761615 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.761755 master-0 kubenswrapper[4807]: I1014 13:34:16.761737 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-kolla-config\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.863007 master-0 kubenswrapper[4807]: I1014 13:34:16.862944 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-cfbgv\" (UniqueName: \"kubernetes.io/projected/27eaf28f-44fc-464e-9901-4914959a1648-kube-api-access-cfbgv\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.863484 master-0 kubenswrapper[4807]: I1014 13:34:16.863448 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.863617 master-0 kubenswrapper[4807]: I1014 13:34:16.863601 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-config-data\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.863697 master-0 kubenswrapper[4807]: I1014 13:34:16.863685 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.863790 master-0 kubenswrapper[4807]: I1014 13:34:16.863774 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-kolla-config\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.864953 master-0 kubenswrapper[4807]: I1014 13:34:16.864933 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-kolla-config\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.865060 master-0 kubenswrapper[4807]: I1014 13:34:16.864969 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/27eaf28f-44fc-464e-9901-4914959a1648-config-data\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.868215 master-0 kubenswrapper[4807]: I1014 13:34:16.868161 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-combined-ca-bundle\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.869192 master-0 kubenswrapper[4807]: I1014 13:34:16.869158 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"memcached-tls-certs\" (UniqueName: \"kubernetes.io/secret/27eaf28f-44fc-464e-9901-4914959a1648-memcached-tls-certs\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.886802 master-0 kubenswrapper[4807]: I1014 13:34:16.886729 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfbgv\" (UniqueName: \"kubernetes.io/projected/27eaf28f-44fc-464e-9901-4914959a1648-kube-api-access-cfbgv\") pod \"memcached-0\" (UID: \"27eaf28f-44fc-464e-9901-4914959a1648\") " pod="openstack/memcached-0" Oct 14 13:34:16.966064 master-0 kubenswrapper[4807]: I1014 13:34:16.965883 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/memcached-0" Oct 14 13:34:17.293483 master-0 kubenswrapper[4807]: I1014 13:34:17.293293 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-69363d1d-a17b-41f9-a6f2-435f6a53e7c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^064fcb14-c5a2-4ea2-b49a-7130a675135c\") pod \"rabbitmq-server-0\" (UID: \"6b34cbbc-c394-4369-9ee0-db4e899c4bbf\") " pod="openstack/rabbitmq-server-0" Oct 14 13:34:17.559695 master-0 kubenswrapper[4807]: I1014 13:34:17.559328 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-server-0" Oct 14 13:34:23.388533 master-0 kubenswrapper[4807]: I1014 13:34:23.388293 4807 generic.go:334] "Generic (PLEG): container finished" podID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerID="e2c541805f129d059b0ed4fbb0930681ec25925dd02e4e300d179671600cd701" exitCode=0 Oct 14 13:34:23.390015 master-0 kubenswrapper[4807]: I1014 13:34:23.388441 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" event={"ID":"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86","Type":"ContainerDied","Data":"e2c541805f129d059b0ed4fbb0930681ec25925dd02e4e300d179671600cd701"} Oct 14 13:34:23.393634 master-0 kubenswrapper[4807]: I1014 13:34:23.393570 4807 generic.go:334] "Generic (PLEG): container finished" podID="c1bb42c7-3374-4ba3-bcce-e0098e15bbec" containerID="e7c879fc184c30bb67af4022dd3929f9245925c3b5d8232997b02585222386e9" exitCode=0 Oct 14 13:34:23.393753 master-0 kubenswrapper[4807]: I1014 13:34:23.393646 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" event={"ID":"c1bb42c7-3374-4ba3-bcce-e0098e15bbec","Type":"ContainerDied","Data":"e7c879fc184c30bb67af4022dd3929f9245925c3b5d8232997b02585222386e9"} Oct 14 13:34:23.659057 master-0 kubenswrapper[4807]: I1014 13:34:23.659005 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:23.773536 master-0 kubenswrapper[4807]: I1014 13:34:23.773480 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dhlt\" (UniqueName: \"kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt\") pod \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " Oct 14 13:34:23.773698 master-0 kubenswrapper[4807]: I1014 13:34:23.773648 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config\") pod \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\" (UID: \"c1bb42c7-3374-4ba3-bcce-e0098e15bbec\") " Oct 14 13:34:23.777411 master-0 kubenswrapper[4807]: I1014 13:34:23.777332 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt" (OuterVolumeSpecName: "kube-api-access-2dhlt") pod "c1bb42c7-3374-4ba3-bcce-e0098e15bbec" (UID: "c1bb42c7-3374-4ba3-bcce-e0098e15bbec"). InnerVolumeSpecName "kube-api-access-2dhlt". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:34:23.790857 master-0 kubenswrapper[4807]: I1014 13:34:23.790793 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config" (OuterVolumeSpecName: "config") pod "c1bb42c7-3374-4ba3-bcce-e0098e15bbec" (UID: "c1bb42c7-3374-4ba3-bcce-e0098e15bbec"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:34:23.876400 master-0 kubenswrapper[4807]: I1014 13:34:23.876308 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:34:23.876400 master-0 kubenswrapper[4807]: I1014 13:34:23.876366 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2dhlt\" (UniqueName: \"kubernetes.io/projected/c1bb42c7-3374-4ba3-bcce-e0098e15bbec-kube-api-access-2dhlt\") on node \"master-0\" DevicePath \"\"" Oct 14 13:34:24.275691 master-0 kubenswrapper[4807]: I1014 13:34:24.275585 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-server-0"] Oct 14 13:34:24.408072 master-0 kubenswrapper[4807]: I1014 13:34:24.407956 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" event={"ID":"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86","Type":"ContainerStarted","Data":"43236a4f0e24726fe8c959c96470f9573f419c11c41748c34bd052b0a1cab618"} Oct 14 13:34:24.409609 master-0 kubenswrapper[4807]: I1014 13:34:24.408218 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:24.410309 master-0 kubenswrapper[4807]: I1014 13:34:24.410266 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" Oct 14 13:34:24.410515 master-0 kubenswrapper[4807]: I1014 13:34:24.410256 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-5bd48d54dc-7mjwq" event={"ID":"c1bb42c7-3374-4ba3-bcce-e0098e15bbec","Type":"ContainerDied","Data":"98d3ee32c7f127bc974895f74e820a9ee2fac87a236e32c960b335c79f6c60c4"} Oct 14 13:34:24.410515 master-0 kubenswrapper[4807]: I1014 13:34:24.410478 4807 scope.go:117] "RemoveContainer" containerID="e7c879fc184c30bb67af4022dd3929f9245925c3b5d8232997b02585222386e9" Oct 14 13:34:24.411628 master-0 kubenswrapper[4807]: I1014 13:34:24.411591 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"6b34cbbc-c394-4369-9ee0-db4e899c4bbf","Type":"ContainerStarted","Data":"b714bd81874ff2fbf46719b44def638b40561c6b317a31bbf472c692437c6021"} Oct 14 13:34:24.875834 master-0 kubenswrapper[4807]: I1014 13:34:24.875761 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/memcached-0"] Oct 14 13:34:25.426265 master-0 kubenswrapper[4807]: I1014 13:34:25.426184 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"27eaf28f-44fc-464e-9901-4914959a1648","Type":"ContainerStarted","Data":"be73b01a73fc77aeeab1923e24a825767dc915013b686731bcefa3dd6676c8f9"} Oct 14 13:34:25.991911 master-0 kubenswrapper[4807]: I1014 13:34:25.991830 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" podStartSLOduration=4.211408053 podStartE2EDuration="14.991808348s" podCreationTimestamp="2025-10-14 13:34:11 +0000 UTC" firstStartedPulling="2025-10-14 13:34:12.045709808 +0000 UTC m=+846.727011632" lastFinishedPulling="2025-10-14 13:34:22.826110103 +0000 UTC m=+857.507411927" observedRunningTime="2025-10-14 13:34:25.763703283 +0000 UTC m=+860.445005107" watchObservedRunningTime="2025-10-14 13:34:25.991808348 +0000 UTC m=+860.673110172" Oct 14 13:34:26.541931 master-0 kubenswrapper[4807]: I1014 13:34:26.540298 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Oct 14 13:34:26.541931 master-0 kubenswrapper[4807]: E1014 13:34:26.540783 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c1bb42c7-3374-4ba3-bcce-e0098e15bbec" containerName="init" Oct 14 13:34:26.541931 master-0 kubenswrapper[4807]: I1014 13:34:26.540810 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1bb42c7-3374-4ba3-bcce-e0098e15bbec" containerName="init" Oct 14 13:34:26.541931 master-0 kubenswrapper[4807]: I1014 13:34:26.541025 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="c1bb42c7-3374-4ba3-bcce-e0098e15bbec" containerName="init" Oct 14 13:34:26.542808 master-0 kubenswrapper[4807]: I1014 13:34:26.542621 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.547320 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-default-user" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.547900 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-plugins-conf" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.547938 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-config-data" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.548024 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-cell1-erlang-cookie" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.548245 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"rabbitmq-cell1-server-conf" Oct 14 13:34:26.548897 master-0 kubenswrapper[4807]: I1014 13:34:26.548503 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-rabbitmq-cell1-svc" Oct 14 13:34:27.359412 master-0 kubenswrapper[4807]: I1014 13:34:27.359348 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Oct 14 13:34:28.449074 master-0 kubenswrapper[4807]: I1014 13:34:28.448976 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/memcached-0" event={"ID":"27eaf28f-44fc-464e-9901-4914959a1648","Type":"ContainerStarted","Data":"42db5f6e2b25dd56fb41685409a11468a22d7e24808aefa272a9fdfd265266d3"} Oct 14 13:34:28.449778 master-0 kubenswrapper[4807]: I1014 13:34:28.449713 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/memcached-0" Oct 14 13:34:28.854179 master-0 kubenswrapper[4807]: I1014 13:34:28.852215 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:28.913882 master-0 kubenswrapper[4807]: I1014 13:34:28.913798 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-5bd48d54dc-7mjwq"] Oct 14 13:34:28.956422 master-0 kubenswrapper[4807]: I1014 13:34:28.956261 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956422 master-0 kubenswrapper[4807]: I1014 13:34:28.956325 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956422 master-0 kubenswrapper[4807]: I1014 13:34:28.956393 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956494 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/039c280b-1c46-4a5d-9cdf-2104d3e5055d-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956525 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956545 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956562 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956594 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-4c4cc3e7-87ba-4606-a755-0ca8f88facd7\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5bd988fc-863f-43d3-8065-1b8da1a8152b\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956620 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/039c280b-1c46-4a5d-9cdf-2104d3e5055d-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956641 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:28.956830 master-0 kubenswrapper[4807]: I1014 13:34:28.956662 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqnm\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-kube-api-access-txqnm\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.002913 master-0 kubenswrapper[4807]: I1014 13:34:29.001420 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/memcached-0" podStartSLOduration=10.212336159 podStartE2EDuration="13.001375854s" podCreationTimestamp="2025-10-14 13:34:16 +0000 UTC" firstStartedPulling="2025-10-14 13:34:24.649020907 +0000 UTC m=+859.330322731" lastFinishedPulling="2025-10-14 13:34:27.438060602 +0000 UTC m=+862.119362426" observedRunningTime="2025-10-14 13:34:28.947802895 +0000 UTC m=+863.629104739" watchObservedRunningTime="2025-10-14 13:34:29.001375854 +0000 UTC m=+863.682677678" Oct 14 13:34:29.060385 master-0 kubenswrapper[4807]: I1014 13:34:29.060312 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060385 master-0 kubenswrapper[4807]: I1014 13:34:29.060388 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/039c280b-1c46-4a5d-9cdf-2104d3e5055d-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060422 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060446 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060506 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060565 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-4c4cc3e7-87ba-4606-a755-0ca8f88facd7\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5bd988fc-863f-43d3-8065-1b8da1a8152b\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060635 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/039c280b-1c46-4a5d-9cdf-2104d3e5055d-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060674 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060717 master-0 kubenswrapper[4807]: I1014 13:34:29.060705 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-txqnm\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-kube-api-access-txqnm\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060999 master-0 kubenswrapper[4807]: I1014 13:34:29.060813 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.060999 master-0 kubenswrapper[4807]: I1014 13:34:29.060850 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.061432 master-0 kubenswrapper[4807]: I1014 13:34:29.061351 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-config-data\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.061665 master-0 kubenswrapper[4807]: I1014 13:34:29.061631 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-plugins\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-plugins\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.061857 master-0 kubenswrapper[4807]: I1014 13:34:29.061817 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"server-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-server-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.062310 master-0 kubenswrapper[4807]: I1014 13:34:29.062257 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-erlang-cookie\" (UniqueName: \"kubernetes.io/empty-dir/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-erlang-cookie\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.062786 master-0 kubenswrapper[4807]: I1014 13:34:29.062556 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"plugins-conf\" (UniqueName: \"kubernetes.io/configmap/039c280b-1c46-4a5d-9cdf-2104d3e5055d-plugins-conf\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.063513 master-0 kubenswrapper[4807]: I1014 13:34:29.063473 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:29.063588 master-0 kubenswrapper[4807]: I1014 13:34:29.063534 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-4c4cc3e7-87ba-4606-a755-0ca8f88facd7\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5bd988fc-863f-43d3-8065-1b8da1a8152b\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/082c0d97edf059758e83348a53225b9133f59a612b3f25d17a055b64c8476f09/globalmount\"" pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.064415 master-0 kubenswrapper[4807]: I1014 13:34:29.064389 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pod-info\" (UniqueName: \"kubernetes.io/downward-api/039c280b-1c46-4a5d-9cdf-2104d3e5055d-pod-info\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.065396 master-0 kubenswrapper[4807]: I1014 13:34:29.065329 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"erlang-cookie-secret\" (UniqueName: \"kubernetes.io/secret/039c280b-1c46-4a5d-9cdf-2104d3e5055d-erlang-cookie-secret\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.073396 master-0 kubenswrapper[4807]: I1014 13:34:29.073315 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-tls\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-tls\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.073628 master-0 kubenswrapper[4807]: I1014 13:34:29.073584 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"rabbitmq-confd\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-rabbitmq-confd\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.093620 master-0 kubenswrapper[4807]: I1014 13:34:29.093171 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqnm\" (UniqueName: \"kubernetes.io/projected/039c280b-1c46-4a5d-9cdf-2104d3e5055d-kube-api-access-txqnm\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:29.461343 master-0 kubenswrapper[4807]: I1014 13:34:29.461251 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"6b34cbbc-c394-4369-9ee0-db4e899c4bbf","Type":"ContainerStarted","Data":"d78d17a12539b1f4fc09e79639c0b5c521173133b64dcfd8c9cd416a60b0190d"} Oct 14 13:34:29.736601 master-0 kubenswrapper[4807]: I1014 13:34:29.736512 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-x94kc"] Oct 14 13:34:29.737704 master-0 kubenswrapper[4807]: I1014 13:34:29.737664 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.740669 master-0 kubenswrapper[4807]: I1014 13:34:29.740614 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-scripts" Oct 14 13:34:29.740858 master-0 kubenswrapper[4807]: I1014 13:34:29.740840 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovncontroller-ovndbs" Oct 14 13:34:29.763785 master-0 kubenswrapper[4807]: I1014 13:34:29.763725 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-x94kc"] Oct 14 13:34:29.787158 master-0 kubenswrapper[4807]: I1014 13:34:29.787083 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-ovs-bpkt9"] Oct 14 13:34:29.788901 master-0 kubenswrapper[4807]: I1014 13:34:29.788865 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.828881 master-0 kubenswrapper[4807]: I1014 13:34:29.828785 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-bpkt9"] Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.872648 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-log\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.872724 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.872966 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-etc-ovs\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.873131 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-ovn-controller-tls-certs\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.873175 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z447v\" (UniqueName: \"kubernetes.io/projected/b4cb48f3-4205-4214-83fd-fa3ae7077a61-kube-api-access-z447v\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.873252 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvw4r\" (UniqueName: \"kubernetes.io/projected/8b145341-cbdf-4a58-abee-9d27f92a2f1c-kube-api-access-dvw4r\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.873319 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-run\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.873571 master-0 kubenswrapper[4807]: I1014 13:34:29.873353 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-combined-ca-bundle\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.874110 master-0 kubenswrapper[4807]: I1014 13:34:29.873708 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-lib\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.874110 master-0 kubenswrapper[4807]: I1014 13:34:29.873878 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.874110 master-0 kubenswrapper[4807]: I1014 13:34:29.873949 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b4cb48f3-4205-4214-83fd-fa3ae7077a61-scripts\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.874110 master-0 kubenswrapper[4807]: I1014 13:34:29.874005 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-log-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.874110 master-0 kubenswrapper[4807]: I1014 13:34:29.874037 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8b145341-cbdf-4a58-abee-9d27f92a2f1c-scripts\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.977633 master-0 kubenswrapper[4807]: I1014 13:34:29.977551 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-combined-ca-bundle\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.977633 master-0 kubenswrapper[4807]: I1014 13:34:29.977649 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-lib\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977678 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977705 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b4cb48f3-4205-4214-83fd-fa3ae7077a61-scripts\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977729 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-log-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977751 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8b145341-cbdf-4a58-abee-9d27f92a2f1c-scripts\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977785 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-log\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977815 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977862 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-etc-ovs\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.977905 master-0 kubenswrapper[4807]: I1014 13:34:29.977899 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-ovn-controller-tls-certs\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.978188 master-0 kubenswrapper[4807]: I1014 13:34:29.977928 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-z447v\" (UniqueName: \"kubernetes.io/projected/b4cb48f3-4205-4214-83fd-fa3ae7077a61-kube-api-access-z447v\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.978188 master-0 kubenswrapper[4807]: I1014 13:34:29.977969 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dvw4r\" (UniqueName: \"kubernetes.io/projected/8b145341-cbdf-4a58-abee-9d27f92a2f1c-kube-api-access-dvw4r\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.978188 master-0 kubenswrapper[4807]: I1014 13:34:29.978001 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-run\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.978756 master-0 kubenswrapper[4807]: I1014 13:34:29.978686 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-run\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.978892 master-0 kubenswrapper[4807]: I1014 13:34:29.978846 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.979070 master-0 kubenswrapper[4807]: I1014 13:34:29.979046 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-lib\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.979135 master-0 kubenswrapper[4807]: I1014 13:34:29.979087 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-var-log\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.979221 master-0 kubenswrapper[4807]: I1014 13:34:29.979100 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-run\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.979277 master-0 kubenswrapper[4807]: I1014 13:34:29.979195 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/b4cb48f3-4205-4214-83fd-fa3ae7077a61-var-log-ovn\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.980084 master-0 kubenswrapper[4807]: I1014 13:34:29.980043 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-ovs\" (UniqueName: \"kubernetes.io/host-path/8b145341-cbdf-4a58-abee-9d27f92a2f1c-etc-ovs\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.980773 master-0 kubenswrapper[4807]: I1014 13:34:29.980739 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/b4cb48f3-4205-4214-83fd-fa3ae7077a61-scripts\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.981380 master-0 kubenswrapper[4807]: I1014 13:34:29.981317 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/8b145341-cbdf-4a58-abee-9d27f92a2f1c-scripts\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:29.983405 master-0 kubenswrapper[4807]: I1014 13:34:29.983361 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-controller-tls-certs\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-ovn-controller-tls-certs\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:29.983750 master-0 kubenswrapper[4807]: I1014 13:34:29.983706 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b4cb48f3-4205-4214-83fd-fa3ae7077a61-combined-ca-bundle\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:30.001444 master-0 kubenswrapper[4807]: I1014 13:34:30.001234 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-z447v\" (UniqueName: \"kubernetes.io/projected/b4cb48f3-4205-4214-83fd-fa3ae7077a61-kube-api-access-z447v\") pod \"ovn-controller-x94kc\" (UID: \"b4cb48f3-4205-4214-83fd-fa3ae7077a61\") " pod="openstack/ovn-controller-x94kc" Oct 14 13:34:30.004545 master-0 kubenswrapper[4807]: I1014 13:34:30.004442 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvw4r\" (UniqueName: \"kubernetes.io/projected/8b145341-cbdf-4a58-abee-9d27f92a2f1c-kube-api-access-dvw4r\") pod \"ovn-controller-ovs-bpkt9\" (UID: \"8b145341-cbdf-4a58-abee-9d27f92a2f1c\") " pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:30.053002 master-0 kubenswrapper[4807]: I1014 13:34:30.052837 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc" Oct 14 13:34:30.129255 master-0 kubenswrapper[4807]: I1014 13:34:30.128916 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:30.280022 master-0 kubenswrapper[4807]: I1014 13:34:30.279017 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1bb42c7-3374-4ba3-bcce-e0098e15bbec" path="/var/lib/kubelet/pods/c1bb42c7-3374-4ba3-bcce-e0098e15bbec/volumes" Oct 14 13:34:30.505189 master-0 kubenswrapper[4807]: I1014 13:34:30.505089 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-4c4cc3e7-87ba-4606-a755-0ca8f88facd7\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5bd988fc-863f-43d3-8065-1b8da1a8152b\") pod \"rabbitmq-cell1-server-0\" (UID: \"039c280b-1c46-4a5d-9cdf-2104d3e5055d\") " pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:30.679307 master-0 kubenswrapper[4807]: W1014 13:34:30.679216 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4cb48f3_4205_4214_83fd_fa3ae7077a61.slice/crio-ab7bf4db793e8e65bbb90707f027625a297b1dd0dbde391b9f230fe3cd169324 WatchSource:0}: Error finding container ab7bf4db793e8e65bbb90707f027625a297b1dd0dbde391b9f230fe3cd169324: Status 404 returned error can't find the container with id ab7bf4db793e8e65bbb90707f027625a297b1dd0dbde391b9f230fe3cd169324 Oct 14 13:34:30.698041 master-0 kubenswrapper[4807]: I1014 13:34:30.697961 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-x94kc"] Oct 14 13:34:30.772409 master-0 kubenswrapper[4807]: I1014 13:34:30.772311 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:34:31.287637 master-0 kubenswrapper[4807]: I1014 13:34:31.287499 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/rabbitmq-cell1-server-0"] Oct 14 13:34:31.289240 master-0 kubenswrapper[4807]: W1014 13:34:31.289180 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod039c280b_1c46_4a5d_9cdf_2104d3e5055d.slice/crio-4e7b5b0250ae355769982709faa0ca579ec69c74caf7aa0fd16a49c52c606492 WatchSource:0}: Error finding container 4e7b5b0250ae355769982709faa0ca579ec69c74caf7aa0fd16a49c52c606492: Status 404 returned error can't find the container with id 4e7b5b0250ae355769982709faa0ca579ec69c74caf7aa0fd16a49c52c606492 Oct 14 13:34:31.485388 master-0 kubenswrapper[4807]: I1014 13:34:31.485327 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-x94kc" event={"ID":"b4cb48f3-4205-4214-83fd-fa3ae7077a61","Type":"ContainerStarted","Data":"ab7bf4db793e8e65bbb90707f027625a297b1dd0dbde391b9f230fe3cd169324"} Oct 14 13:34:31.486970 master-0 kubenswrapper[4807]: I1014 13:34:31.486941 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"039c280b-1c46-4a5d-9cdf-2104d3e5055d","Type":"ContainerStarted","Data":"4e7b5b0250ae355769982709faa0ca579ec69c74caf7aa0fd16a49c52c606492"} Oct 14 13:34:31.493796 master-0 kubenswrapper[4807]: I1014 13:34:31.493750 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:32.062174 master-0 kubenswrapper[4807]: I1014 13:34:32.061935 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-ovs-bpkt9"] Oct 14 13:34:32.089571 master-0 kubenswrapper[4807]: W1014 13:34:32.089450 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b145341_cbdf_4a58_abee_9d27f92a2f1c.slice/crio-bfbf528a0b1bfa5663511fc01329817ab94f28227089eab2978007b1b0b1f5b2 WatchSource:0}: Error finding container bfbf528a0b1bfa5663511fc01329817ab94f28227089eab2978007b1b0b1f5b2: Status 404 returned error can't find the container with id bfbf528a0b1bfa5663511fc01329817ab94f28227089eab2978007b1b0b1f5b2 Oct 14 13:34:32.476014 master-0 kubenswrapper[4807]: I1014 13:34:32.475946 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-metrics-skfmd"] Oct 14 13:34:32.477051 master-0 kubenswrapper[4807]: I1014 13:34:32.477017 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.479406 master-0 kubenswrapper[4807]: I1014 13:34:32.479345 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovn-metrics" Oct 14 13:34:32.479713 master-0 kubenswrapper[4807]: I1014 13:34:32.479695 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-metrics-config" Oct 14 13:34:32.514499 master-0 kubenswrapper[4807]: I1014 13:34:32.505306 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"039c280b-1c46-4a5d-9cdf-2104d3e5055d","Type":"ContainerStarted","Data":"780baa671556f2668fba71f1208ff82a53e055adff9842eedc27a2a47200aa8b"} Oct 14 13:34:32.514499 master-0 kubenswrapper[4807]: I1014 13:34:32.508397 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-bpkt9" event={"ID":"8b145341-cbdf-4a58-abee-9d27f92a2f1c","Type":"ContainerStarted","Data":"bfbf528a0b1bfa5663511fc01329817ab94f28227089eab2978007b1b0b1f5b2"} Oct 14 13:34:32.526701 master-0 kubenswrapper[4807]: I1014 13:34:32.526635 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-config\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.526970 master-0 kubenswrapper[4807]: I1014 13:34:32.526719 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-combined-ca-bundle\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.526970 master-0 kubenswrapper[4807]: I1014 13:34:32.526767 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lstr\" (UniqueName: \"kubernetes.io/projected/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-kube-api-access-5lstr\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.526970 master-0 kubenswrapper[4807]: I1014 13:34:32.526829 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.526970 master-0 kubenswrapper[4807]: I1014 13:34:32.526905 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovs-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.527218 master-0 kubenswrapper[4807]: I1014 13:34:32.527123 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovn-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.543984 master-0 kubenswrapper[4807]: I1014 13:34:32.543930 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-skfmd"] Oct 14 13:34:32.629235 master-0 kubenswrapper[4807]: I1014 13:34:32.629154 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:34:32.631250 master-0 kubenswrapper[4807]: I1014 13:34:32.630327 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovn-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631250 master-0 kubenswrapper[4807]: I1014 13:34:32.631109 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.631384 master-0 kubenswrapper[4807]: I1014 13:34:32.630049 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovn-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631505 master-0 kubenswrapper[4807]: I1014 13:34:32.631491 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-config\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631601 master-0 kubenswrapper[4807]: I1014 13:34:32.631588 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-combined-ca-bundle\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631722 master-0 kubenswrapper[4807]: I1014 13:34:32.631706 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5lstr\" (UniqueName: \"kubernetes.io/projected/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-kube-api-access-5lstr\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631838 master-0 kubenswrapper[4807]: I1014 13:34:32.631825 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.631934 master-0 kubenswrapper[4807]: I1014 13:34:32.631922 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovs-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.632099 master-0 kubenswrapper[4807]: I1014 13:34:32.632085 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovs-rundir\" (UniqueName: \"kubernetes.io/host-path/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-ovs-rundir\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.632797 master-0 kubenswrapper[4807]: I1014 13:34:32.632583 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-config\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.636972 master-0 kubenswrapper[4807]: I1014 13:34:32.636932 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-metrics-certs-tls-certs\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.637046 master-0 kubenswrapper[4807]: I1014 13:34:32.637000 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-combined-ca-bundle\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.678029 master-0 kubenswrapper[4807]: I1014 13:34:32.673689 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:34:32.684057 master-0 kubenswrapper[4807]: I1014 13:34:32.684006 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lstr\" (UniqueName: \"kubernetes.io/projected/bbd6184a-a103-45fd-92e4-ad2adcd9cddc-kube-api-access-5lstr\") pod \"ovn-controller-metrics-skfmd\" (UID: \"bbd6184a-a103-45fd-92e4-ad2adcd9cddc\") " pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.811533 master-0 kubenswrapper[4807]: I1014 13:34:32.808856 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-metrics-skfmd" Oct 14 13:34:32.835598 master-0 kubenswrapper[4807]: I1014 13:34:32.835516 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffp5n\" (UniqueName: \"kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.835849 master-0 kubenswrapper[4807]: I1014 13:34:32.835778 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.835900 master-0 kubenswrapper[4807]: I1014 13:34:32.835886 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.937894 master-0 kubenswrapper[4807]: I1014 13:34:32.937808 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.937894 master-0 kubenswrapper[4807]: I1014 13:34:32.937899 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ffp5n\" (UniqueName: \"kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:32.938285 master-0 kubenswrapper[4807]: I1014 13:34:32.937987 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:33.035227 master-0 kubenswrapper[4807]: I1014 13:34:33.034993 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:33.035227 master-0 kubenswrapper[4807]: I1014 13:34:33.035047 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:33.038356 master-0 kubenswrapper[4807]: I1014 13:34:33.038302 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffp5n\" (UniqueName: \"kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n\") pod \"dnsmasq-dns-7bf7489945-kqcjc\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:33.272307 master-0 kubenswrapper[4807]: I1014 13:34:33.272228 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:35.503688 master-0 kubenswrapper[4807]: I1014 13:34:35.503621 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:34:35.508912 master-0 kubenswrapper[4807]: W1014 13:34:35.508835 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod738ae160_140c_4bde_b7d1_7be858c0f33f.slice/crio-4d14397064590b3979de76f9034ed029cfbd131755a74e36d00dd1555a52f0b0 WatchSource:0}: Error finding container 4d14397064590b3979de76f9034ed029cfbd131755a74e36d00dd1555a52f0b0: Status 404 returned error can't find the container with id 4d14397064590b3979de76f9034ed029cfbd131755a74e36d00dd1555a52f0b0 Oct 14 13:34:35.535739 master-0 kubenswrapper[4807]: I1014 13:34:35.535508 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" event={"ID":"738ae160-140c-4bde-b7d1-7be858c0f33f","Type":"ContainerStarted","Data":"4d14397064590b3979de76f9034ed029cfbd131755a74e36d00dd1555a52f0b0"} Oct 14 13:34:35.606319 master-0 kubenswrapper[4807]: I1014 13:34:35.606223 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-metrics-skfmd"] Oct 14 13:34:35.614214 master-0 kubenswrapper[4807]: W1014 13:34:35.614142 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbd6184a_a103_45fd_92e4_ad2adcd9cddc.slice/crio-d1c86828a63e34f06d5279ef501ee485fec294eb3c95afd55256c2251d83ffc1 WatchSource:0}: Error finding container d1c86828a63e34f06d5279ef501ee485fec294eb3c95afd55256c2251d83ffc1: Status 404 returned error can't find the container with id d1c86828a63e34f06d5279ef501ee485fec294eb3c95afd55256c2251d83ffc1 Oct 14 13:34:36.556016 master-0 kubenswrapper[4807]: I1014 13:34:36.555820 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-x94kc" event={"ID":"b4cb48f3-4205-4214-83fd-fa3ae7077a61","Type":"ContainerStarted","Data":"67d23225fbc6cfb5233d221e88dc04ec2f399881ec9e2c1a050b5c01c785c235"} Oct 14 13:34:36.556016 master-0 kubenswrapper[4807]: I1014 13:34:36.555981 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-x94kc" Oct 14 13:34:36.559298 master-0 kubenswrapper[4807]: I1014 13:34:36.559247 4807 generic.go:334] "Generic (PLEG): container finished" podID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerID="bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f" exitCode=0 Oct 14 13:34:36.559573 master-0 kubenswrapper[4807]: I1014 13:34:36.559402 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" event={"ID":"738ae160-140c-4bde-b7d1-7be858c0f33f","Type":"ContainerDied","Data":"bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f"} Oct 14 13:34:36.563315 master-0 kubenswrapper[4807]: I1014 13:34:36.563261 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-skfmd" event={"ID":"bbd6184a-a103-45fd-92e4-ad2adcd9cddc","Type":"ContainerStarted","Data":"d1c86828a63e34f06d5279ef501ee485fec294eb3c95afd55256c2251d83ffc1"} Oct 14 13:34:36.565783 master-0 kubenswrapper[4807]: I1014 13:34:36.565738 4807 generic.go:334] "Generic (PLEG): container finished" podID="8b145341-cbdf-4a58-abee-9d27f92a2f1c" containerID="bc912b2ad66997eaa185df044a44328be47e58fc28d21bcbee853904ee945bae" exitCode=0 Oct 14 13:34:36.565783 master-0 kubenswrapper[4807]: I1014 13:34:36.565773 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-bpkt9" event={"ID":"8b145341-cbdf-4a58-abee-9d27f92a2f1c","Type":"ContainerDied","Data":"bc912b2ad66997eaa185df044a44328be47e58fc28d21bcbee853904ee945bae"} Oct 14 13:34:36.585331 master-0 kubenswrapper[4807]: I1014 13:34:36.585231 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-x94kc" podStartSLOduration=3.034940116 podStartE2EDuration="7.585203817s" podCreationTimestamp="2025-10-14 13:34:29 +0000 UTC" firstStartedPulling="2025-10-14 13:34:30.682047651 +0000 UTC m=+865.363349475" lastFinishedPulling="2025-10-14 13:34:35.232311352 +0000 UTC m=+869.913613176" observedRunningTime="2025-10-14 13:34:36.579301331 +0000 UTC m=+871.260603155" watchObservedRunningTime="2025-10-14 13:34:36.585203817 +0000 UTC m=+871.266505651" Oct 14 13:34:36.969122 master-0 kubenswrapper[4807]: I1014 13:34:36.969056 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/memcached-0" Oct 14 13:34:37.341388 master-0 kubenswrapper[4807]: I1014 13:34:37.341326 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-galera-0"] Oct 14 13:34:37.344572 master-0 kubenswrapper[4807]: I1014 13:34:37.344538 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Oct 14 13:34:37.347653 master-0 kubenswrapper[4807]: I1014 13:34:37.347601 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-svc" Oct 14 13:34:37.347977 master-0 kubenswrapper[4807]: I1014 13:34:37.347948 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-config-data" Oct 14 13:34:37.348179 master-0 kubenswrapper[4807]: I1014 13:34:37.348150 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"osp-secret" Oct 14 13:34:37.348425 master-0 kubenswrapper[4807]: I1014 13:34:37.348391 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-scripts" Oct 14 13:34:37.359548 master-0 kubenswrapper[4807]: I1014 13:34:37.359490 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Oct 14 13:34:37.436686 master-0 kubenswrapper[4807]: I1014 13:34:37.436523 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-secrets\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.436886 master-0 kubenswrapper[4807]: I1014 13:34:37.436732 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-default\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.436886 master-0 kubenswrapper[4807]: I1014 13:34:37.436780 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.436886 master-0 kubenswrapper[4807]: I1014 13:34:37.436846 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.437011 master-0 kubenswrapper[4807]: I1014 13:34:37.436940 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-kolla-config\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.437011 master-0 kubenswrapper[4807]: I1014 13:34:37.436993 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-7683a646-b7ab-4d96-a58d-493f254943c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^2d8460ae-67ff-431c-a7fb-cf9b731dec5f\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.437201 master-0 kubenswrapper[4807]: I1014 13:34:37.437124 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.437257 master-0 kubenswrapper[4807]: I1014 13:34:37.437202 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.437545 master-0 kubenswrapper[4807]: I1014 13:34:37.437511 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v7dz\" (UniqueName: \"kubernetes.io/projected/ac478a28-479f-4885-a21a-1d0d4d0ed776-kube-api-access-7v7dz\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539397 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7v7dz\" (UniqueName: \"kubernetes.io/projected/ac478a28-479f-4885-a21a-1d0d4d0ed776-kube-api-access-7v7dz\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539480 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-secrets\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539525 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-default\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539552 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539572 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539614 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-kolla-config\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539636 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-7683a646-b7ab-4d96-a58d-493f254943c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^2d8460ae-67ff-431c-a7fb-cf9b731dec5f\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539656 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.540915 master-0 kubenswrapper[4807]: I1014 13:34:37.539682 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.541581 master-0 kubenswrapper[4807]: I1014 13:34:37.540972 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-generated\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.541712 master-0 kubenswrapper[4807]: I1014 13:34:37.541661 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-kolla-config\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.542718 master-0 kubenswrapper[4807]: I1014 13:34:37.541451 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-config-data-default\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.544122 master-0 kubenswrapper[4807]: I1014 13:34:37.544082 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-galera-tls-certs\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.544994 master-0 kubenswrapper[4807]: I1014 13:34:37.544942 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:37.545057 master-0 kubenswrapper[4807]: I1014 13:34:37.545001 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-7683a646-b7ab-4d96-a58d-493f254943c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^2d8460ae-67ff-431c-a7fb-cf9b731dec5f\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/1ff6472ac60739065695e6a28e8092390611ed30c9635ac0929cca08b99da4a1/globalmount\"" pod="openstack/openstack-galera-0" Oct 14 13:34:37.546058 master-0 kubenswrapper[4807]: I1014 13:34:37.545988 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/ac478a28-479f-4885-a21a-1d0d4d0ed776-operator-scripts\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.546187 master-0 kubenswrapper[4807]: I1014 13:34:37.546022 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-secrets\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.547177 master-0 kubenswrapper[4807]: I1014 13:34:37.547133 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ac478a28-479f-4885-a21a-1d0d4d0ed776-combined-ca-bundle\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.561790 master-0 kubenswrapper[4807]: I1014 13:34:37.561717 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v7dz\" (UniqueName: \"kubernetes.io/projected/ac478a28-479f-4885-a21a-1d0d4d0ed776-kube-api-access-7v7dz\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:37.576851 master-0 kubenswrapper[4807]: I1014 13:34:37.576764 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-bpkt9" event={"ID":"8b145341-cbdf-4a58-abee-9d27f92a2f1c","Type":"ContainerStarted","Data":"953ed310c2c3e0d04b585dba32a24eacbe1f2cf0c796000eaa7d95269d4657f6"} Oct 14 13:34:37.577055 master-0 kubenswrapper[4807]: I1014 13:34:37.576864 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-ovs-bpkt9" event={"ID":"8b145341-cbdf-4a58-abee-9d27f92a2f1c","Type":"ContainerStarted","Data":"67d1b5d976547d819ba8f702c36cc635b5e88d54af3b80108bb73a7a5f4e3599"} Oct 14 13:34:37.577151 master-0 kubenswrapper[4807]: I1014 13:34:37.577092 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:37.577199 master-0 kubenswrapper[4807]: I1014 13:34:37.577177 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:34:37.579787 master-0 kubenswrapper[4807]: I1014 13:34:37.579742 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" event={"ID":"738ae160-140c-4bde-b7d1-7be858c0f33f","Type":"ContainerStarted","Data":"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441"} Oct 14 13:34:37.579855 master-0 kubenswrapper[4807]: I1014 13:34:37.579790 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:37.617745 master-0 kubenswrapper[4807]: I1014 13:34:37.617623 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-ovs-bpkt9" podStartSLOduration=5.503171285 podStartE2EDuration="8.617597345s" podCreationTimestamp="2025-10-14 13:34:29 +0000 UTC" firstStartedPulling="2025-10-14 13:34:32.091811988 +0000 UTC m=+866.773113832" lastFinishedPulling="2025-10-14 13:34:35.206238068 +0000 UTC m=+869.887539892" observedRunningTime="2025-10-14 13:34:37.613981423 +0000 UTC m=+872.295283247" watchObservedRunningTime="2025-10-14 13:34:37.617597345 +0000 UTC m=+872.298899189" Oct 14 13:34:37.655733 master-0 kubenswrapper[4807]: I1014 13:34:37.655631 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" podStartSLOduration=5.655598505 podStartE2EDuration="5.655598505s" podCreationTimestamp="2025-10-14 13:34:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:34:37.653808994 +0000 UTC m=+872.335110828" watchObservedRunningTime="2025-10-14 13:34:37.655598505 +0000 UTC m=+872.336900359" Oct 14 13:34:38.897070 master-0 kubenswrapper[4807]: I1014 13:34:38.896875 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-7683a646-b7ab-4d96-a58d-493f254943c4\" (UniqueName: \"kubernetes.io/csi/topolvm.io^2d8460ae-67ff-431c-a7fb-cf9b731dec5f\") pod \"openstack-galera-0\" (UID: \"ac478a28-479f-4885-a21a-1d0d4d0ed776\") " pod="openstack/openstack-galera-0" Oct 14 13:34:39.173104 master-0 kubenswrapper[4807]: I1014 13:34:39.173009 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-galera-0" Oct 14 13:34:39.599103 master-0 kubenswrapper[4807]: I1014 13:34:39.598953 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-metrics-skfmd" event={"ID":"bbd6184a-a103-45fd-92e4-ad2adcd9cddc","Type":"ContainerStarted","Data":"b981f7062d9ff6604ffafe86aa16cb2b07a74394f399f980d5d768cceade2212"} Oct 14 13:34:39.628067 master-0 kubenswrapper[4807]: I1014 13:34:39.627971 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-controller-metrics-skfmd" podStartSLOduration=4.232782611 podStartE2EDuration="7.627933037s" podCreationTimestamp="2025-10-14 13:34:32 +0000 UTC" firstStartedPulling="2025-10-14 13:34:35.61709273 +0000 UTC m=+870.298394554" lastFinishedPulling="2025-10-14 13:34:39.012243156 +0000 UTC m=+873.693544980" observedRunningTime="2025-10-14 13:34:39.621417394 +0000 UTC m=+874.302719238" watchObservedRunningTime="2025-10-14 13:34:39.627933037 +0000 UTC m=+874.309234861" Oct 14 13:34:39.674867 master-0 kubenswrapper[4807]: I1014 13:34:39.674755 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-galera-0"] Oct 14 13:34:40.589645 master-0 kubenswrapper[4807]: I1014 13:34:40.589585 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/openstack-cell1-galera-0"] Oct 14 13:34:40.591782 master-0 kubenswrapper[4807]: I1014 13:34:40.591704 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.597295 master-0 kubenswrapper[4807]: I1014 13:34:40.595799 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-config-data" Oct 14 13:34:40.597295 master-0 kubenswrapper[4807]: I1014 13:34:40.596308 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"openstack-cell1-scripts" Oct 14 13:34:40.597295 master-0 kubenswrapper[4807]: I1014 13:34:40.596567 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-galera-openstack-cell1-svc" Oct 14 13:34:40.615138 master-0 kubenswrapper[4807]: I1014 13:34:40.615031 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"ac478a28-479f-4885-a21a-1d0d4d0ed776","Type":"ContainerStarted","Data":"f57946c18affd8124e559b7a70d417290f827f0d1d9d0069c1c3a202199cf4fd"} Oct 14 13:34:40.620942 master-0 kubenswrapper[4807]: I1014 13:34:40.620866 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Oct 14 13:34:40.695333 master-0 kubenswrapper[4807]: I1014 13:34:40.695223 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-6861d9ee-c832-451b-a43d-36937439d12d\" (UniqueName: \"kubernetes.io/csi/topolvm.io^eecc50e8-1265-4bdb-8b81-c96b350e2a23\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.695568 master-0 kubenswrapper[4807]: I1014 13:34:40.695398 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/17994f92-4b38-43ce-81ad-1990f2857dbc-kube-api-access-vggb2\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.695923 master-0 kubenswrapper[4807]: I1014 13:34:40.695815 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.696437 master-0 kubenswrapper[4807]: I1014 13:34:40.696363 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.696614 master-0 kubenswrapper[4807]: I1014 13:34:40.696540 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.696713 master-0 kubenswrapper[4807]: I1014 13:34:40.696641 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-secrets\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.696803 master-0 kubenswrapper[4807]: I1014 13:34:40.696770 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.697389 master-0 kubenswrapper[4807]: I1014 13:34:40.696860 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.700232 master-0 kubenswrapper[4807]: I1014 13:34:40.700190 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803204 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/17994f92-4b38-43ce-81ad-1990f2857dbc-kube-api-access-vggb2\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803330 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803373 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803414 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803450 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-secrets\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.803486 master-0 kubenswrapper[4807]: I1014 13:34:40.803500 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.804005 master-0 kubenswrapper[4807]: I1014 13:34:40.803525 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.804005 master-0 kubenswrapper[4807]: I1014 13:34:40.803564 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.804005 master-0 kubenswrapper[4807]: I1014 13:34:40.803606 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-6861d9ee-c832-451b-a43d-36937439d12d\" (UniqueName: \"kubernetes.io/csi/topolvm.io^eecc50e8-1265-4bdb-8b81-c96b350e2a23\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.810478 master-0 kubenswrapper[4807]: I1014 13:34:40.805211 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kolla-config\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-kolla-config\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.810478 master-0 kubenswrapper[4807]: I1014 13:34:40.809202 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-combined-ca-bundle\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.810478 master-0 kubenswrapper[4807]: I1014 13:34:40.809775 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-generated\" (UniqueName: \"kubernetes.io/empty-dir/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-generated\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.820483 master-0 kubenswrapper[4807]: I1014 13:34:40.811365 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"operator-scripts\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-operator-scripts\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.820483 master-0 kubenswrapper[4807]: I1014 13:34:40.812601 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-default\" (UniqueName: \"kubernetes.io/configmap/17994f92-4b38-43ce-81ad-1990f2857dbc-config-data-default\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.820483 master-0 kubenswrapper[4807]: I1014 13:34:40.815945 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secrets\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-secrets\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.827479 master-0 kubenswrapper[4807]: I1014 13:34:40.822009 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:40.827479 master-0 kubenswrapper[4807]: I1014 13:34:40.822057 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-6861d9ee-c832-451b-a43d-36937439d12d\" (UniqueName: \"kubernetes.io/csi/topolvm.io^eecc50e8-1265-4bdb-8b81-c96b350e2a23\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0beb9f14d85b609bc53966fed35c9b59c24a8a1e3312dfc3f272a22ea93d2803/globalmount\"" pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.827479 master-0 kubenswrapper[4807]: I1014 13:34:40.823024 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"galera-tls-certs\" (UniqueName: \"kubernetes.io/secret/17994f92-4b38-43ce-81ad-1990f2857dbc-galera-tls-certs\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:40.842563 master-0 kubenswrapper[4807]: I1014 13:34:40.842002 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggb2\" (UniqueName: \"kubernetes.io/projected/17994f92-4b38-43ce-81ad-1990f2857dbc-kube-api-access-vggb2\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:42.000725 master-0 kubenswrapper[4807]: I1014 13:34:42.000670 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-6861d9ee-c832-451b-a43d-36937439d12d\" (UniqueName: \"kubernetes.io/csi/topolvm.io^eecc50e8-1265-4bdb-8b81-c96b350e2a23\") pod \"openstack-cell1-galera-0\" (UID: \"17994f92-4b38-43ce-81ad-1990f2857dbc\") " pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:42.117555 master-0 kubenswrapper[4807]: I1014 13:34:42.117448 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:43.273949 master-0 kubenswrapper[4807]: I1014 13:34:43.273873 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:34:43.351216 master-0 kubenswrapper[4807]: I1014 13:34:43.351144 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:43.351584 master-0 kubenswrapper[4807]: I1014 13:34:43.351541 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="dnsmasq-dns" containerID="cri-o://43236a4f0e24726fe8c959c96470f9573f419c11c41748c34bd052b0a1cab618" gracePeriod=10 Oct 14 13:34:43.653651 master-0 kubenswrapper[4807]: I1014 13:34:43.653568 4807 generic.go:334] "Generic (PLEG): container finished" podID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerID="43236a4f0e24726fe8c959c96470f9573f419c11c41748c34bd052b0a1cab618" exitCode=0 Oct 14 13:34:43.653651 master-0 kubenswrapper[4807]: I1014 13:34:43.653639 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" event={"ID":"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86","Type":"ContainerDied","Data":"43236a4f0e24726fe8c959c96470f9573f419c11c41748c34bd052b0a1cab618"} Oct 14 13:34:44.156486 master-0 kubenswrapper[4807]: I1014 13:34:44.152334 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:34:44.156486 master-0 kubenswrapper[4807]: I1014 13:34:44.154337 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.160487 master-0 kubenswrapper[4807]: I1014 13:34:44.157799 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage" Oct 14 13:34:44.160487 master-0 kubenswrapper[4807]: I1014 13:34:44.158163 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-web-config" Oct 14 13:34:44.160487 master-0 kubenswrapper[4807]: I1014 13:34:44.158441 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-thanos-prometheus-http-client-file" Oct 14 13:34:44.160487 master-0 kubenswrapper[4807]: I1014 13:34:44.158983 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"prometheus-metric-storage-rulefiles-0" Oct 14 13:34:44.174492 master-0 kubenswrapper[4807]: I1014 13:34:44.168635 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-tls-assets-0" Oct 14 13:34:44.234586 master-0 kubenswrapper[4807]: I1014 13:34:44.234518 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:34:44.304650 master-0 kubenswrapper[4807]: I1014 13:34:44.304574 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.304650 master-0 kubenswrapper[4807]: I1014 13:34:44.304640 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304699 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2zf9\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304728 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304763 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304791 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304811 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.305471 master-0 kubenswrapper[4807]: I1014 13:34:44.304862 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.407220 master-0 kubenswrapper[4807]: I1014 13:34:44.407145 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zf9\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408116 master-0 kubenswrapper[4807]: I1014 13:34:44.408077 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408190 master-0 kubenswrapper[4807]: I1014 13:34:44.408162 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408229 master-0 kubenswrapper[4807]: I1014 13:34:44.408198 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408267 master-0 kubenswrapper[4807]: I1014 13:34:44.408250 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408432 master-0 kubenswrapper[4807]: I1014 13:34:44.408398 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408525 master-0 kubenswrapper[4807]: I1014 13:34:44.408502 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.408597 master-0 kubenswrapper[4807]: I1014 13:34:44.408572 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.409546 master-0 kubenswrapper[4807]: I1014 13:34:44.409480 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.411817 master-0 kubenswrapper[4807]: I1014 13:34:44.411774 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:44.411889 master-0 kubenswrapper[4807]: I1014 13:34:44.411818 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/ffc0741878f52394f16aa241b4969439dcd9d77d9120cf853c2ff2dd6d6609ca/globalmount\"" pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.412503 master-0 kubenswrapper[4807]: I1014 13:34:44.412449 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.412615 master-0 kubenswrapper[4807]: I1014 13:34:44.412562 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.413955 master-0 kubenswrapper[4807]: I1014 13:34:44.413904 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.414729 master-0 kubenswrapper[4807]: I1014 13:34:44.414288 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.418516 master-0 kubenswrapper[4807]: I1014 13:34:44.418413 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.427746 master-0 kubenswrapper[4807]: I1014 13:34:44.427703 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2zf9\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:44.542538 master-0 kubenswrapper[4807]: I1014 13:34:44.542219 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:44.665089 master-0 kubenswrapper[4807]: I1014 13:34:44.665038 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/openstack-cell1-galera-0"] Oct 14 13:34:44.666516 master-0 kubenswrapper[4807]: I1014 13:34:44.666486 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" Oct 14 13:34:44.666516 master-0 kubenswrapper[4807]: I1014 13:34:44.666441 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-697b8fd54f-zqxb9" event={"ID":"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86","Type":"ContainerDied","Data":"f50ef2312fa2e563e4291a7c5c3ceb9dfb33f96293f48a2bff3e3d7acdccf9e0"} Oct 14 13:34:44.666619 master-0 kubenswrapper[4807]: I1014 13:34:44.666534 4807 scope.go:117] "RemoveContainer" containerID="43236a4f0e24726fe8c959c96470f9573f419c11c41748c34bd052b0a1cab618" Oct 14 13:34:44.669703 master-0 kubenswrapper[4807]: I1014 13:34:44.668311 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"ac478a28-479f-4885-a21a-1d0d4d0ed776","Type":"ContainerStarted","Data":"19863ae421fc2e9439c3396bd1ff4f3210fa9371550d66479fc75865bc926ade"} Oct 14 13:34:44.698052 master-0 kubenswrapper[4807]: I1014 13:34:44.686477 4807 scope.go:117] "RemoveContainer" containerID="e2c541805f129d059b0ed4fbb0930681ec25925dd02e4e300d179671600cd701" Oct 14 13:34:44.725958 master-0 kubenswrapper[4807]: I1014 13:34:44.725885 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ssvqm\" (UniqueName: \"kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm\") pod \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " Oct 14 13:34:44.726242 master-0 kubenswrapper[4807]: I1014 13:34:44.726120 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config\") pod \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " Oct 14 13:34:44.726242 master-0 kubenswrapper[4807]: I1014 13:34:44.726155 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc\") pod \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\" (UID: \"2f55b727-642e-4fc0-bc2c-ed3dbb30fa86\") " Oct 14 13:34:44.732832 master-0 kubenswrapper[4807]: I1014 13:34:44.732743 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm" (OuterVolumeSpecName: "kube-api-access-ssvqm") pod "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" (UID: "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86"). InnerVolumeSpecName "kube-api-access-ssvqm". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:34:44.760734 master-0 kubenswrapper[4807]: I1014 13:34:44.760676 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" (UID: "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:34:44.763422 master-0 kubenswrapper[4807]: I1014 13:34:44.763372 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config" (OuterVolumeSpecName: "config") pod "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" (UID: "2f55b727-642e-4fc0-bc2c-ed3dbb30fa86"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:34:44.828615 master-0 kubenswrapper[4807]: I1014 13:34:44.828560 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ssvqm\" (UniqueName: \"kubernetes.io/projected/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-kube-api-access-ssvqm\") on node \"master-0\" DevicePath \"\"" Oct 14 13:34:44.828773 master-0 kubenswrapper[4807]: I1014 13:34:44.828749 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:34:44.829766 master-0 kubenswrapper[4807]: I1014 13:34:44.829687 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:34:45.014890 master-0 kubenswrapper[4807]: I1014 13:34:45.014815 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:45.031436 master-0 kubenswrapper[4807]: I1014 13:34:45.030497 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-697b8fd54f-zqxb9"] Oct 14 13:34:45.513515 master-0 kubenswrapper[4807]: I1014 13:34:45.513408 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-nb-0"] Oct 14 13:34:45.514301 master-0 kubenswrapper[4807]: E1014 13:34:45.513871 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="init" Oct 14 13:34:45.514301 master-0 kubenswrapper[4807]: I1014 13:34:45.513895 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="init" Oct 14 13:34:45.514301 master-0 kubenswrapper[4807]: E1014 13:34:45.513926 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="dnsmasq-dns" Oct 14 13:34:45.514301 master-0 kubenswrapper[4807]: I1014 13:34:45.513937 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="dnsmasq-dns" Oct 14 13:34:45.514301 master-0 kubenswrapper[4807]: I1014 13:34:45.514122 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" containerName="dnsmasq-dns" Oct 14 13:34:45.515362 master-0 kubenswrapper[4807]: I1014 13:34:45.515279 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.518701 master-0 kubenswrapper[4807]: I1014 13:34:45.518575 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-nb-ovndbs" Oct 14 13:34:45.518701 master-0 kubenswrapper[4807]: I1014 13:34:45.518623 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-config" Oct 14 13:34:45.519861 master-0 kubenswrapper[4807]: I1014 13:34:45.519798 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-nb-scripts" Oct 14 13:34:45.563531 master-0 kubenswrapper[4807]: I1014 13:34:45.563413 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Oct 14 13:34:45.646728 master-0 kubenswrapper[4807]: I1014 13:34:45.646673 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dr6n\" (UniqueName: \"kubernetes.io/projected/18c57980-028d-4b56-a45a-4ebc81e9b75d-kube-api-access-4dr6n\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.646728 master-0 kubenswrapper[4807]: I1014 13:34:45.646739 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647046 master-0 kubenswrapper[4807]: I1014 13:34:45.646784 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647046 master-0 kubenswrapper[4807]: I1014 13:34:45.646808 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647046 master-0 kubenswrapper[4807]: I1014 13:34:45.646829 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-bf38ab45-4965-4593-9615-1d7e94664218\" (UniqueName: \"kubernetes.io/csi/topolvm.io^9f2d9ee6-f15f-4b0f-bca8-78cac113a515\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647046 master-0 kubenswrapper[4807]: I1014 13:34:45.646854 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647312 master-0 kubenswrapper[4807]: I1014 13:34:45.647249 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.647433 master-0 kubenswrapper[4807]: I1014 13:34:45.647398 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-config\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.687261 master-0 kubenswrapper[4807]: I1014 13:34:45.687178 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"17994f92-4b38-43ce-81ad-1990f2857dbc","Type":"ContainerStarted","Data":"2477b526f61e09b6984949ae14d4350866274d642cb53a65bb2857c2111ae025"} Oct 14 13:34:45.687261 master-0 kubenswrapper[4807]: I1014 13:34:45.687238 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"17994f92-4b38-43ce-81ad-1990f2857dbc","Type":"ContainerStarted","Data":"94c59f8214ace66f958c5aadf29ad1930a7b0bd86c729d5136a48d3ecda656dc"} Oct 14 13:34:45.749095 master-0 kubenswrapper[4807]: I1014 13:34:45.749021 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.749095 master-0 kubenswrapper[4807]: I1014 13:34:45.749102 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-config\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749175 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4dr6n\" (UniqueName: \"kubernetes.io/projected/18c57980-028d-4b56-a45a-4ebc81e9b75d-kube-api-access-4dr6n\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749215 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749259 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749284 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749313 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-bf38ab45-4965-4593-9615-1d7e94664218\" (UniqueName: \"kubernetes.io/csi/topolvm.io^9f2d9ee6-f15f-4b0f-bca8-78cac113a515\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749343 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.750057 master-0 kubenswrapper[4807]: I1014 13:34:45.749755 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdb-rundir\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.751743 master-0 kubenswrapper[4807]: I1014 13:34:45.751719 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:45.751825 master-0 kubenswrapper[4807]: I1014 13:34:45.751756 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-bf38ab45-4965-4593-9615-1d7e94664218\" (UniqueName: \"kubernetes.io/csi/topolvm.io^9f2d9ee6-f15f-4b0f-bca8-78cac113a515\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/52711bc12d54f162155c40b8b15a62587a157fb54022550e549b7845be1b5156/globalmount\"" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.752719 master-0 kubenswrapper[4807]: I1014 13:34:45.752573 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-scripts\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.752719 master-0 kubenswrapper[4807]: I1014 13:34:45.752649 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c57980-028d-4b56-a45a-4ebc81e9b75d-config\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.755528 master-0 kubenswrapper[4807]: I1014 13:34:45.754121 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-metrics-certs-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.755528 master-0 kubenswrapper[4807]: I1014 13:34:45.755001 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-combined-ca-bundle\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.755874 master-0 kubenswrapper[4807]: I1014 13:34:45.755779 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb-tls-certs\" (UniqueName: \"kubernetes.io/secret/18c57980-028d-4b56-a45a-4ebc81e9b75d-ovsdbserver-nb-tls-certs\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:45.777252 master-0 kubenswrapper[4807]: I1014 13:34:45.777101 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dr6n\" (UniqueName: \"kubernetes.io/projected/18c57980-028d-4b56-a45a-4ebc81e9b75d-kube-api-access-4dr6n\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:46.278105 master-0 kubenswrapper[4807]: I1014 13:34:46.278028 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f55b727-642e-4fc0-bc2c-ed3dbb30fa86" path="/var/lib/kubelet/pods/2f55b727-642e-4fc0-bc2c-ed3dbb30fa86/volumes" Oct 14 13:34:46.876136 master-0 kubenswrapper[4807]: I1014 13:34:46.875983 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:46.909240 master-0 kubenswrapper[4807]: I1014 13:34:46.909160 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:34:47.458808 master-0 kubenswrapper[4807]: I1014 13:34:47.458704 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:34:47.708587 master-0 kubenswrapper[4807]: I1014 13:34:47.708486 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerStarted","Data":"b3dcb0b3866b44c4f06b99432de11f18427bc76f6b0b44e1b48f8025bf54c8fc"} Oct 14 13:34:48.403912 master-0 kubenswrapper[4807]: I1014 13:34:48.403837 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-bf38ab45-4965-4593-9615-1d7e94664218\" (UniqueName: \"kubernetes.io/csi/topolvm.io^9f2d9ee6-f15f-4b0f-bca8-78cac113a515\") pod \"ovsdbserver-nb-0\" (UID: \"18c57980-028d-4b56-a45a-4ebc81e9b75d\") " pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:48.855269 master-0 kubenswrapper[4807]: I1014 13:34:48.855125 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:49.441089 master-0 kubenswrapper[4807]: I1014 13:34:49.441025 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovsdbserver-sb-2"] Oct 14 13:34:49.442571 master-0 kubenswrapper[4807]: I1014 13:34:49.442538 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:49.446055 master-0 kubenswrapper[4807]: I1014 13:34:49.445973 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovndbcluster-sb-ovndbs" Oct 14 13:34:49.446374 master-0 kubenswrapper[4807]: I1014 13:34:49.446187 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-scripts" Oct 14 13:34:49.446646 master-0 kubenswrapper[4807]: I1014 13:34:49.446618 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovndbcluster-sb-config" Oct 14 13:34:49.466111 master-0 kubenswrapper[4807]: I1014 13:34:49.466051 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-2"] Oct 14 13:34:49.674744 master-0 kubenswrapper[4807]: W1014 13:34:49.674667 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18c57980_028d_4b56_a45a_4ebc81e9b75d.slice/crio-76e80b7333cedbe79ba29dc2c258bbbf78727582dace81103dd4904032770d6a WatchSource:0}: Error finding container 76e80b7333cedbe79ba29dc2c258bbbf78727582dace81103dd4904032770d6a: Status 404 returned error can't find the container with id 76e80b7333cedbe79ba29dc2c258bbbf78727582dace81103dd4904032770d6a Oct 14 13:34:49.722064 master-0 kubenswrapper[4807]: I1014 13:34:49.721853 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"18c57980-028d-4b56-a45a-4ebc81e9b75d","Type":"ContainerStarted","Data":"76e80b7333cedbe79ba29dc2c258bbbf78727582dace81103dd4904032770d6a"} Oct 14 13:34:50.040942 master-0 kubenswrapper[4807]: I1014 13:34:50.040723 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-nb-0"] Oct 14 13:34:50.733444 master-0 kubenswrapper[4807]: I1014 13:34:50.733366 4807 generic.go:334] "Generic (PLEG): container finished" podID="ac478a28-479f-4885-a21a-1d0d4d0ed776" containerID="19863ae421fc2e9439c3396bd1ff4f3210fa9371550d66479fc75865bc926ade" exitCode=0 Oct 14 13:34:50.734318 master-0 kubenswrapper[4807]: I1014 13:34:50.733492 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"ac478a28-479f-4885-a21a-1d0d4d0ed776","Type":"ContainerDied","Data":"19863ae421fc2e9439c3396bd1ff4f3210fa9371550d66479fc75865bc926ade"} Oct 14 13:34:50.735625 master-0 kubenswrapper[4807]: I1014 13:34:50.735575 4807 generic.go:334] "Generic (PLEG): container finished" podID="17994f92-4b38-43ce-81ad-1990f2857dbc" containerID="2477b526f61e09b6984949ae14d4350866274d642cb53a65bb2857c2111ae025" exitCode=0 Oct 14 13:34:50.735742 master-0 kubenswrapper[4807]: I1014 13:34:50.735629 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"17994f92-4b38-43ce-81ad-1990f2857dbc","Type":"ContainerDied","Data":"2477b526f61e09b6984949ae14d4350866274d642cb53a65bb2857c2111ae025"} Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355062 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355209 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-combined-ca-bundle\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355262 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355292 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdb-rundir\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355325 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-scripts\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355351 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f656d6df-5ed7-49ec-b9dc-9ed2009fef82\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5cc0fcc6-41e6-479e-9e6c-c11a82b7d9a0\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355372 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-config\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.357197 master-0 kubenswrapper[4807]: I1014 13:34:51.355402 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff4z6\" (UniqueName: \"kubernetes.io/projected/ef87c03d-a14f-44e5-b7d9-6b417abdb560-kube-api-access-ff4z6\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457105 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-combined-ca-bundle\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457223 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457266 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdb-rundir\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457299 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-scripts\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457348 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-config\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457350 master-0 kubenswrapper[4807]: I1014 13:34:51.457373 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ff4z6\" (UniqueName: \"kubernetes.io/projected/ef87c03d-a14f-44e5-b7d9-6b417abdb560-kube-api-access-ff4z6\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.457965 master-0 kubenswrapper[4807]: I1014 13:34:51.457437 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.458186 master-0 kubenswrapper[4807]: I1014 13:34:51.458122 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdb-rundir\" (UniqueName: \"kubernetes.io/empty-dir/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdb-rundir\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.458763 master-0 kubenswrapper[4807]: I1014 13:34:51.458722 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-config\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.459064 master-0 kubenswrapper[4807]: I1014 13:34:51.459029 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/ef87c03d-a14f-44e5-b7d9-6b417abdb560-scripts\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.461978 master-0 kubenswrapper[4807]: I1014 13:34:51.461892 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-ovsdbserver-sb-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.462145 master-0 kubenswrapper[4807]: I1014 13:34:51.462082 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-metrics-certs-tls-certs\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.462581 master-0 kubenswrapper[4807]: I1014 13:34:51.462542 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/ef87c03d-a14f-44e5-b7d9-6b417abdb560-combined-ca-bundle\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.478708 master-0 kubenswrapper[4807]: I1014 13:34:51.478628 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff4z6\" (UniqueName: \"kubernetes.io/projected/ef87c03d-a14f-44e5-b7d9-6b417abdb560-kube-api-access-ff4z6\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:51.749124 master-0 kubenswrapper[4807]: I1014 13:34:51.748923 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-cell1-galera-0" event={"ID":"17994f92-4b38-43ce-81ad-1990f2857dbc","Type":"ContainerStarted","Data":"fd44ee978850fc91438dae12f6f7c4744a3ac6652e2d166947f337b694f2170f"} Oct 14 13:34:51.752112 master-0 kubenswrapper[4807]: I1014 13:34:51.752053 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/openstack-galera-0" event={"ID":"ac478a28-479f-4885-a21a-1d0d4d0ed776","Type":"ContainerStarted","Data":"c51dc334434d06e4656d24901e76175fe8dbd279476678ba7a7e7f0f543bd7e3"} Oct 14 13:34:51.754606 master-0 kubenswrapper[4807]: I1014 13:34:51.754562 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"18c57980-028d-4b56-a45a-4ebc81e9b75d","Type":"ContainerStarted","Data":"a7605f31c3cd0e2c99a6812ce3d46987eacd4bc6e76be42237be2c3a1dfafa4f"} Oct 14 13:34:51.754606 master-0 kubenswrapper[4807]: I1014 13:34:51.754600 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-nb-0" event={"ID":"18c57980-028d-4b56-a45a-4ebc81e9b75d","Type":"ContainerStarted","Data":"738da5a8f7caaf4a11bb7b30a92604dc7a18e8069cb5f41624117f29a03a02a0"} Oct 14 13:34:51.856023 master-0 kubenswrapper[4807]: I1014 13:34:51.855887 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:52.117853 master-0 kubenswrapper[4807]: I1014 13:34:52.117726 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:52.118788 master-0 kubenswrapper[4807]: I1014 13:34:52.118712 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-cell1-galera-0" Oct 14 13:34:52.767821 master-0 kubenswrapper[4807]: I1014 13:34:52.767711 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerStarted","Data":"e5e444f0ca2fd980bc433b0546caa8cfb5494ad33d44d3cc3496e78aed8ebd4e"} Oct 14 13:34:53.601611 master-0 kubenswrapper[4807]: I1014 13:34:53.601510 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-f656d6df-5ed7-49ec-b9dc-9ed2009fef82\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5cc0fcc6-41e6-479e-9e6c-c11a82b7d9a0\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:53.614236 master-0 kubenswrapper[4807]: I1014 13:34:53.614142 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:34:53.614740 master-0 kubenswrapper[4807]: I1014 13:34:53.614267 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-f656d6df-5ed7-49ec-b9dc-9ed2009fef82\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5cc0fcc6-41e6-479e-9e6c-c11a82b7d9a0\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/9447d0b469a6db2a87d1b1797495c367e70581f4884a36ab915daf15e9959911/globalmount\"" pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:53.856112 master-0 kubenswrapper[4807]: I1014 13:34:53.855961 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:54.724102 master-0 kubenswrapper[4807]: I1014 13:34:54.723936 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-cell1-galera-0" podStartSLOduration=40.723883462 podStartE2EDuration="40.723883462s" podCreationTimestamp="2025-10-14 13:34:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:34:54.716246646 +0000 UTC m=+889.397548470" watchObservedRunningTime="2025-10-14 13:34:54.723883462 +0000 UTC m=+889.405185406" Oct 14 13:34:54.898711 master-0 kubenswrapper[4807]: I1014 13:34:54.898594 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:55.139104 master-0 kubenswrapper[4807]: I1014 13:34:55.138955 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/openstack-galera-0" podStartSLOduration=37.611758062 podStartE2EDuration="42.138922042s" podCreationTimestamp="2025-10-14 13:34:13 +0000 UTC" firstStartedPulling="2025-10-14 13:34:39.685421946 +0000 UTC m=+874.366723810" lastFinishedPulling="2025-10-14 13:34:44.212585966 +0000 UTC m=+878.893887790" observedRunningTime="2025-10-14 13:34:55.016266487 +0000 UTC m=+889.697568351" watchObservedRunningTime="2025-10-14 13:34:55.138922042 +0000 UTC m=+889.820223906" Oct 14 13:34:55.207858 master-0 kubenswrapper[4807]: I1014 13:34:55.207695 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-f656d6df-5ed7-49ec-b9dc-9ed2009fef82\" (UniqueName: \"kubernetes.io/csi/topolvm.io^5cc0fcc6-41e6-479e-9e6c-c11a82b7d9a0\") pod \"ovsdbserver-sb-2\" (UID: \"ef87c03d-a14f-44e5-b7d9-6b417abdb560\") " pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:55.242479 master-0 kubenswrapper[4807]: I1014 13:34:55.242330 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-nb-0" podStartSLOduration=25.248180304 podStartE2EDuration="26.242302684s" podCreationTimestamp="2025-10-14 13:34:29 +0000 UTC" firstStartedPulling="2025-10-14 13:34:49.677884589 +0000 UTC m=+884.359186453" lastFinishedPulling="2025-10-14 13:34:50.672007019 +0000 UTC m=+885.353308833" observedRunningTime="2025-10-14 13:34:55.235624965 +0000 UTC m=+889.916926849" watchObservedRunningTime="2025-10-14 13:34:55.242302684 +0000 UTC m=+889.923604548" Oct 14 13:34:55.466134 master-0 kubenswrapper[4807]: I1014 13:34:55.465963 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovsdbserver-sb-2" Oct 14 13:34:55.841323 master-0 kubenswrapper[4807]: I1014 13:34:55.841189 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-nb-0" Oct 14 13:34:57.029489 master-0 kubenswrapper[4807]: I1014 13:34:57.029411 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovsdbserver-sb-2"] Oct 14 13:34:57.819970 master-0 kubenswrapper[4807]: I1014 13:34:57.819890 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-2" event={"ID":"ef87c03d-a14f-44e5-b7d9-6b417abdb560","Type":"ContainerStarted","Data":"56f1171c413e224f3f73bbf2d06e9f990f9a0edc9effa0e76679ce004e30affe"} Oct 14 13:34:58.829338 master-0 kubenswrapper[4807]: I1014 13:34:58.829270 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-2" event={"ID":"ef87c03d-a14f-44e5-b7d9-6b417abdb560","Type":"ContainerStarted","Data":"d81b1923f336da75bc3ea6e20afe6189acb75d5bafc52d29cf52b9acf146509e"} Oct 14 13:34:58.829338 master-0 kubenswrapper[4807]: I1014 13:34:58.829328 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovsdbserver-sb-2" event={"ID":"ef87c03d-a14f-44e5-b7d9-6b417abdb560","Type":"ContainerStarted","Data":"a7688522403febb955a2ed53c56dac5a2e86570ee30fe9992c0a03f8b531a5cb"} Oct 14 13:34:58.865997 master-0 kubenswrapper[4807]: I1014 13:34:58.865898 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovsdbserver-sb-2" podStartSLOduration=27.53857973 podStartE2EDuration="28.865866493s" podCreationTimestamp="2025-10-14 13:34:30 +0000 UTC" firstStartedPulling="2025-10-14 13:34:57.057578502 +0000 UTC m=+891.738880326" lastFinishedPulling="2025-10-14 13:34:58.384865265 +0000 UTC m=+893.066167089" observedRunningTime="2025-10-14 13:34:58.864012401 +0000 UTC m=+893.545314225" watchObservedRunningTime="2025-10-14 13:34:58.865866493 +0000 UTC m=+893.547168317" Oct 14 13:34:59.173716 master-0 kubenswrapper[4807]: I1014 13:34:59.173646 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/openstack-galera-0" Oct 14 13:34:59.173716 master-0 kubenswrapper[4807]: I1014 13:34:59.173718 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/openstack-galera-0" Oct 14 13:35:00.467212 master-0 kubenswrapper[4807]: I1014 13:35:00.467131 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovsdbserver-sb-2" Oct 14 13:35:01.466575 master-0 kubenswrapper[4807]: I1014 13:35:01.466424 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/ovsdbserver-sb-2" Oct 14 13:35:01.514513 master-0 kubenswrapper[4807]: I1014 13:35:01.514336 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/ovsdbserver-sb-2" Oct 14 13:35:01.856653 master-0 kubenswrapper[4807]: I1014 13:35:01.856561 4807 generic.go:334] "Generic (PLEG): container finished" podID="6b34cbbc-c394-4369-9ee0-db4e899c4bbf" containerID="d78d17a12539b1f4fc09e79639c0b5c521173133b64dcfd8c9cd416a60b0190d" exitCode=0 Oct 14 13:35:01.856985 master-0 kubenswrapper[4807]: I1014 13:35:01.856704 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"6b34cbbc-c394-4369-9ee0-db4e899c4bbf","Type":"ContainerDied","Data":"d78d17a12539b1f4fc09e79639c0b5c521173133b64dcfd8c9cd416a60b0190d"} Oct 14 13:35:01.858844 master-0 kubenswrapper[4807]: I1014 13:35:01.858615 4807 generic.go:334] "Generic (PLEG): container finished" podID="defbed72-be31-4758-926e-70192a138b0a" containerID="e5e444f0ca2fd980bc433b0546caa8cfb5494ad33d44d3cc3496e78aed8ebd4e" exitCode=0 Oct 14 13:35:01.858982 master-0 kubenswrapper[4807]: I1014 13:35:01.858898 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerDied","Data":"e5e444f0ca2fd980bc433b0546caa8cfb5494ad33d44d3cc3496e78aed8ebd4e"} Oct 14 13:35:02.867220 master-0 kubenswrapper[4807]: I1014 13:35:02.867132 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-server-0" event={"ID":"6b34cbbc-c394-4369-9ee0-db4e899c4bbf","Type":"ContainerStarted","Data":"844f63fe325b0922f92b133c3b92f59c4ff4a9d09dd2c8eaf939179b06487eb8"} Oct 14 13:35:02.867985 master-0 kubenswrapper[4807]: I1014 13:35:02.867678 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-server-0" Oct 14 13:35:02.899551 master-0 kubenswrapper[4807]: I1014 13:35:02.899409 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-server-0" podStartSLOduration=48.730439324 podStartE2EDuration="51.899377359s" podCreationTimestamp="2025-10-14 13:34:11 +0000 UTC" firstStartedPulling="2025-10-14 13:34:24.283324447 +0000 UTC m=+858.964626271" lastFinishedPulling="2025-10-14 13:34:27.452262482 +0000 UTC m=+862.133564306" observedRunningTime="2025-10-14 13:35:02.895284384 +0000 UTC m=+897.576586228" watchObservedRunningTime="2025-10-14 13:35:02.899377359 +0000 UTC m=+897.580679203" Oct 14 13:35:04.892233 master-0 kubenswrapper[4807]: I1014 13:35:04.892174 4807 generic.go:334] "Generic (PLEG): container finished" podID="039c280b-1c46-4a5d-9cdf-2104d3e5055d" containerID="780baa671556f2668fba71f1208ff82a53e055adff9842eedc27a2a47200aa8b" exitCode=0 Oct 14 13:35:04.892967 master-0 kubenswrapper[4807]: I1014 13:35:04.892240 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"039c280b-1c46-4a5d-9cdf-2104d3e5055d","Type":"ContainerDied","Data":"780baa671556f2668fba71f1208ff82a53e055adff9842eedc27a2a47200aa8b"} Oct 14 13:35:05.089351 master-0 kubenswrapper[4807]: I1014 13:35:05.089290 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-x94kc" podUID="b4cb48f3-4205-4214-83fd-fa3ae7077a61" containerName="ovn-controller" probeResult="failure" output=< Oct 14 13:35:05.089351 master-0 kubenswrapper[4807]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Oct 14 13:35:05.089351 master-0 kubenswrapper[4807]: > Oct 14 13:35:05.509891 master-0 kubenswrapper[4807]: I1014 13:35:05.509764 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovsdbserver-sb-2" Oct 14 13:35:05.902344 master-0 kubenswrapper[4807]: I1014 13:35:05.902277 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/rabbitmq-cell1-server-0" event={"ID":"039c280b-1c46-4a5d-9cdf-2104d3e5055d","Type":"ContainerStarted","Data":"b6584869015a08d51d11d477dab684f29f445223f39af2a5d9e4c3f04ddb80c4"} Oct 14 13:35:05.903662 master-0 kubenswrapper[4807]: I1014 13:35:05.902897 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:35:06.417738 master-0 kubenswrapper[4807]: I1014 13:35:06.417636 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/rabbitmq-cell1-server-0" podStartSLOduration=55.417606792 podStartE2EDuration="55.417606792s" podCreationTimestamp="2025-10-14 13:34:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:35:06.134361625 +0000 UTC m=+900.815663449" watchObservedRunningTime="2025-10-14 13:35:06.417606792 +0000 UTC m=+901.098908626" Oct 14 13:35:07.232061 master-0 kubenswrapper[4807]: I1014 13:35:07.231410 4807 trace.go:236] Trace[1579576063]: "Calculate volume metrics of ovndbcluster-nb-etc-ovn for pod openstack/ovsdbserver-nb-0" (14-Oct-2025 13:35:06.143) (total time: 1087ms): Oct 14 13:35:07.232061 master-0 kubenswrapper[4807]: Trace[1579576063]: [1.08748015s] [1.08748015s] END Oct 14 13:35:07.420617 master-0 kubenswrapper[4807]: I1014 13:35:07.420546 4807 trace.go:236] Trace[757349080]: "Calculate volume metrics of mysql-db for pod openstack/openstack-cell1-galera-0" (14-Oct-2025 13:35:06.143) (total time: 1277ms): Oct 14 13:35:07.420617 master-0 kubenswrapper[4807]: Trace[757349080]: [1.277254195s] [1.277254195s] END Oct 14 13:35:07.923940 master-0 kubenswrapper[4807]: I1014 13:35:07.922497 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:35:07.923940 master-0 kubenswrapper[4807]: I1014 13:35:07.922897 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="dnsmasq-dns" containerID="cri-o://1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441" gracePeriod=10 Oct 14 13:35:08.154815 master-0 kubenswrapper[4807]: I1014 13:35:08.154642 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-northd-0"] Oct 14 13:35:08.178500 master-0 kubenswrapper[4807]: I1014 13:35:08.174132 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Oct 14 13:35:08.178500 master-0 kubenswrapper[4807]: I1014 13:35:08.174411 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Oct 14 13:35:08.178500 master-0 kubenswrapper[4807]: I1014 13:35:08.178003 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ovnnorthd-ovndbs" Oct 14 13:35:08.194276 master-0 kubenswrapper[4807]: I1014 13:35:08.188803 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-config" Oct 14 13:35:08.194276 master-0 kubenswrapper[4807]: I1014 13:35:08.189881 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovnnorthd-scripts" Oct 14 13:35:08.273936 master-0 kubenswrapper[4807]: I1014 13:35:08.273867 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="dnsmasq-dns" probeResult="failure" output="dial tcp 10.130.0.72:5353: connect: connection refused" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.300913 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301008 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r4cb\" (UniqueName: \"kubernetes.io/projected/13b062e3-fe6f-434c-ad43-35679b54ed60-kube-api-access-4r4cb\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301060 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301127 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-config\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301170 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301305 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-scripts\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.302606 master-0 kubenswrapper[4807]: I1014 13:35:08.301370 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423536 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423657 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-4r4cb\" (UniqueName: \"kubernetes.io/projected/13b062e3-fe6f-434c-ad43-35679b54ed60-kube-api-access-4r4cb\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423702 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423745 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-config\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423769 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423802 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-scripts\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.423832 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.425487 master-0 kubenswrapper[4807]: I1014 13:35:08.424429 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-rundir\" (UniqueName: \"kubernetes.io/empty-dir/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-rundir\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.426004 master-0 kubenswrapper[4807]: I1014 13:35:08.425727 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-config\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.435486 master-0 kubenswrapper[4807]: I1014 13:35:08.431446 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-combined-ca-bundle\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.435486 master-0 kubenswrapper[4807]: I1014 13:35:08.433730 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/13b062e3-fe6f-434c-ad43-35679b54ed60-scripts\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.440574 master-0 kubenswrapper[4807]: I1014 13:35:08.436804 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"metrics-certs-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-metrics-certs-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.456504 master-0 kubenswrapper[4807]: I1014 13:35:08.452511 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r4cb\" (UniqueName: \"kubernetes.io/projected/13b062e3-fe6f-434c-ad43-35679b54ed60-kube-api-access-4r4cb\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.467059 master-0 kubenswrapper[4807]: I1014 13:35:08.465755 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovn-northd-tls-certs\" (UniqueName: \"kubernetes.io/secret/13b062e3-fe6f-434c-ad43-35679b54ed60-ovn-northd-tls-certs\") pod \"ovn-northd-0\" (UID: \"13b062e3-fe6f-434c-ad43-35679b54ed60\") " pod="openstack/ovn-northd-0" Oct 14 13:35:08.590014 master-0 kubenswrapper[4807]: I1014 13:35:08.589930 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-northd-0" Oct 14 13:35:08.697469 master-0 kubenswrapper[4807]: I1014 13:35:08.695666 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:35:08.836890 master-0 kubenswrapper[4807]: I1014 13:35:08.836811 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffp5n\" (UniqueName: \"kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n\") pod \"738ae160-140c-4bde-b7d1-7be858c0f33f\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " Oct 14 13:35:08.836890 master-0 kubenswrapper[4807]: I1014 13:35:08.836884 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc\") pod \"738ae160-140c-4bde-b7d1-7be858c0f33f\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " Oct 14 13:35:08.837146 master-0 kubenswrapper[4807]: I1014 13:35:08.837080 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config\") pod \"738ae160-140c-4bde-b7d1-7be858c0f33f\" (UID: \"738ae160-140c-4bde-b7d1-7be858c0f33f\") " Oct 14 13:35:08.847860 master-0 kubenswrapper[4807]: I1014 13:35:08.847770 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n" (OuterVolumeSpecName: "kube-api-access-ffp5n") pod "738ae160-140c-4bde-b7d1-7be858c0f33f" (UID: "738ae160-140c-4bde-b7d1-7be858c0f33f"). InnerVolumeSpecName "kube-api-access-ffp5n". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:08.880256 master-0 kubenswrapper[4807]: I1014 13:35:08.880184 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "738ae160-140c-4bde-b7d1-7be858c0f33f" (UID: "738ae160-140c-4bde-b7d1-7be858c0f33f"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:35:08.926631 master-0 kubenswrapper[4807]: I1014 13:35:08.919160 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config" (OuterVolumeSpecName: "config") pod "738ae160-140c-4bde-b7d1-7be858c0f33f" (UID: "738ae160-140c-4bde-b7d1-7be858c0f33f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:35:08.943938 master-0 kubenswrapper[4807]: I1014 13:35:08.943873 4807 generic.go:334] "Generic (PLEG): container finished" podID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerID="1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441" exitCode=0 Oct 14 13:35:08.944281 master-0 kubenswrapper[4807]: I1014 13:35:08.944080 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" event={"ID":"738ae160-140c-4bde-b7d1-7be858c0f33f","Type":"ContainerDied","Data":"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441"} Oct 14 13:35:08.944281 master-0 kubenswrapper[4807]: I1014 13:35:08.944185 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" event={"ID":"738ae160-140c-4bde-b7d1-7be858c0f33f","Type":"ContainerDied","Data":"4d14397064590b3979de76f9034ed029cfbd131755a74e36d00dd1555a52f0b0"} Oct 14 13:35:08.944281 master-0 kubenswrapper[4807]: I1014 13:35:08.944210 4807 scope.go:117] "RemoveContainer" containerID="1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441" Oct 14 13:35:08.944438 master-0 kubenswrapper[4807]: I1014 13:35:08.944131 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-7bf7489945-kqcjc" Oct 14 13:35:08.947843 master-0 kubenswrapper[4807]: I1014 13:35:08.947758 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:08.947843 master-0 kubenswrapper[4807]: I1014 13:35:08.947794 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ffp5n\" (UniqueName: \"kubernetes.io/projected/738ae160-140c-4bde-b7d1-7be858c0f33f-kube-api-access-ffp5n\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:08.947843 master-0 kubenswrapper[4807]: I1014 13:35:08.947815 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/738ae160-140c-4bde-b7d1-7be858c0f33f-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:08.955373 master-0 kubenswrapper[4807]: I1014 13:35:08.955326 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerStarted","Data":"f452ef707be015c051014ebbed79d626132ab7be5903d6179d9ce81b7160f330"} Oct 14 13:35:08.985933 master-0 kubenswrapper[4807]: I1014 13:35:08.981291 4807 scope.go:117] "RemoveContainer" containerID="bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f" Oct 14 13:35:09.035013 master-0 kubenswrapper[4807]: I1014 13:35:09.034920 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:35:09.061523 master-0 kubenswrapper[4807]: I1014 13:35:09.056963 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-7bf7489945-kqcjc"] Oct 14 13:35:09.068022 master-0 kubenswrapper[4807]: I1014 13:35:09.067621 4807 scope.go:117] "RemoveContainer" containerID="1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441" Oct 14 13:35:09.072711 master-0 kubenswrapper[4807]: E1014 13:35:09.072075 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441\": container with ID starting with 1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441 not found: ID does not exist" containerID="1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441" Oct 14 13:35:09.072711 master-0 kubenswrapper[4807]: I1014 13:35:09.072168 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441"} err="failed to get container status \"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441\": rpc error: code = NotFound desc = could not find container \"1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441\": container with ID starting with 1db50e315e4d858e835c79f83bc53311dd440f8d9a9644906d87c633e05ba441 not found: ID does not exist" Oct 14 13:35:09.072711 master-0 kubenswrapper[4807]: I1014 13:35:09.072211 4807 scope.go:117] "RemoveContainer" containerID="bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f" Oct 14 13:35:09.076017 master-0 kubenswrapper[4807]: E1014 13:35:09.075662 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f\": container with ID starting with bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f not found: ID does not exist" containerID="bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f" Oct 14 13:35:09.076017 master-0 kubenswrapper[4807]: I1014 13:35:09.075812 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f"} err="failed to get container status \"bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f\": rpc error: code = NotFound desc = could not find container \"bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f\": container with ID starting with bba63902db8e4c8f7d9233016f05a8ee68032195fedc93668e3347b889f1a83f not found: ID does not exist" Oct 14 13:35:09.153641 master-0 kubenswrapper[4807]: I1014 13:35:09.153575 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:35:09.154377 master-0 kubenswrapper[4807]: E1014 13:35:09.154354 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="init" Oct 14 13:35:09.154518 master-0 kubenswrapper[4807]: I1014 13:35:09.154502 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="init" Oct 14 13:35:09.154628 master-0 kubenswrapper[4807]: E1014 13:35:09.154614 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="dnsmasq-dns" Oct 14 13:35:09.154704 master-0 kubenswrapper[4807]: I1014 13:35:09.154691 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="dnsmasq-dns" Oct 14 13:35:09.155164 master-0 kubenswrapper[4807]: I1014 13:35:09.155099 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" containerName="dnsmasq-dns" Oct 14 13:35:09.159545 master-0 kubenswrapper[4807]: I1014 13:35:09.159350 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.164086 master-0 kubenswrapper[4807]: I1014 13:35:09.162523 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:35:09.164086 master-0 kubenswrapper[4807]: I1014 13:35:09.162918 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:35:09.164086 master-0 kubenswrapper[4807]: I1014 13:35:09.163053 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:35:09.164086 master-0 kubenswrapper[4807]: I1014 13:35:09.163212 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:35:09.233981 master-0 kubenswrapper[4807]: I1014 13:35:09.233804 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:35:09.352986 master-0 kubenswrapper[4807]: I1014 13:35:09.352892 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ks2qx\" (UniqueName: \"kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.353626 master-0 kubenswrapper[4807]: I1014 13:35:09.353002 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.353626 master-0 kubenswrapper[4807]: I1014 13:35:09.353087 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.353626 master-0 kubenswrapper[4807]: I1014 13:35:09.353112 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.353626 master-0 kubenswrapper[4807]: I1014 13:35:09.353135 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.372491 master-0 kubenswrapper[4807]: I1014 13:35:09.368588 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-northd-0"] Oct 14 13:35:09.458491 master-0 kubenswrapper[4807]: I1014 13:35:09.456566 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-ks2qx\" (UniqueName: \"kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458491 master-0 kubenswrapper[4807]: I1014 13:35:09.456672 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458491 master-0 kubenswrapper[4807]: I1014 13:35:09.456734 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458491 master-0 kubenswrapper[4807]: I1014 13:35:09.456755 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458491 master-0 kubenswrapper[4807]: I1014 13:35:09.456770 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458967 master-0 kubenswrapper[4807]: I1014 13:35:09.458718 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.458967 master-0 kubenswrapper[4807]: I1014 13:35:09.458724 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.464482 master-0 kubenswrapper[4807]: I1014 13:35:09.459412 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.464482 master-0 kubenswrapper[4807]: I1014 13:35:09.459588 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.488608 master-0 kubenswrapper[4807]: I1014 13:35:09.488230 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-ks2qx\" (UniqueName: \"kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx\") pod \"dnsmasq-dns-68f9c67449-hlrvr\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.773844 master-0 kubenswrapper[4807]: I1014 13:35:09.773764 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:09.966114 master-0 kubenswrapper[4807]: I1014 13:35:09.966017 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"13b062e3-fe6f-434c-ad43-35679b54ed60","Type":"ContainerStarted","Data":"c4f06641de97a555b9c23973be0ddd9c7377a5448003b5b7b4ca75af3d9613ba"} Oct 14 13:35:10.277560 master-0 kubenswrapper[4807]: I1014 13:35:10.275746 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="738ae160-140c-4bde-b7d1-7be858c0f33f" path="/var/lib/kubelet/pods/738ae160-140c-4bde-b7d1-7be858c0f33f/volumes" Oct 14 13:35:10.280815 master-0 kubenswrapper[4807]: I1014 13:35:10.280695 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:35:10.320331 master-0 kubenswrapper[4807]: I1014 13:35:10.320246 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-x94kc" podUID="b4cb48f3-4205-4214-83fd-fa3ae7077a61" containerName="ovn-controller" probeResult="failure" output=< Oct 14 13:35:10.320331 master-0 kubenswrapper[4807]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Oct 14 13:35:10.320331 master-0 kubenswrapper[4807]: > Oct 14 13:35:10.332355 master-0 kubenswrapper[4807]: I1014 13:35:10.332313 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:35:10.332683 master-0 kubenswrapper[4807]: I1014 13:35:10.332667 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-ovs-bpkt9" Oct 14 13:35:10.572392 master-0 kubenswrapper[4807]: W1014 13:35:10.572309 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f467642_b1df_446a_8b9b_6aadf9a4332d.slice/crio-a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d WatchSource:0}: Error finding container a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d: Status 404 returned error can't find the container with id a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d Oct 14 13:35:10.981164 master-0 kubenswrapper[4807]: I1014 13:35:10.981092 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerStarted","Data":"81da5068d73284bec2acdbe49db063e23ed78ab9029a1e924b2cf0da438f1fd5"} Oct 14 13:35:10.983038 master-0 kubenswrapper[4807]: I1014 13:35:10.982979 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerStarted","Data":"c045ffa99aea9933c2e053ad45abc365d421f6217fa10d41696c636439ff50b9"} Oct 14 13:35:10.983038 master-0 kubenswrapper[4807]: I1014 13:35:10.983014 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerStarted","Data":"a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d"} Oct 14 13:35:11.991884 master-0 kubenswrapper[4807]: I1014 13:35:11.991803 4807 generic.go:334] "Generic (PLEG): container finished" podID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerID="c045ffa99aea9933c2e053ad45abc365d421f6217fa10d41696c636439ff50b9" exitCode=0 Oct 14 13:35:11.991884 master-0 kubenswrapper[4807]: I1014 13:35:11.991873 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerDied","Data":"c045ffa99aea9933c2e053ad45abc365d421f6217fa10d41696c636439ff50b9"} Oct 14 13:35:11.994891 master-0 kubenswrapper[4807]: I1014 13:35:11.994859 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"13b062e3-fe6f-434c-ad43-35679b54ed60","Type":"ContainerStarted","Data":"356e706fe06ecbbc1b7340f6828402b8001d7ad20caf78d617401cf5d090269c"} Oct 14 13:35:11.994891 master-0 kubenswrapper[4807]: I1014 13:35:11.994885 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-northd-0" event={"ID":"13b062e3-fe6f-434c-ad43-35679b54ed60","Type":"ContainerStarted","Data":"6ba2513bc9da7198017258c4cb96357baa9358ad0c7debe7bc39a5bc51a9c2e7"} Oct 14 13:35:11.995322 master-0 kubenswrapper[4807]: I1014 13:35:11.995299 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ovn-northd-0" Oct 14 13:35:13.005475 master-0 kubenswrapper[4807]: I1014 13:35:13.005384 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerStarted","Data":"bca282b9ecd428681c42986c3fb6fbe668e710435b688758c102c5757202f56d"} Oct 14 13:35:14.015629 master-0 kubenswrapper[4807]: I1014 13:35:14.015549 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerStarted","Data":"f129ba3b234a24a9377030e5d280eb222b6ed607d0ee5fac0648abbb7a7c8f50"} Oct 14 13:35:14.016470 master-0 kubenswrapper[4807]: I1014 13:35:14.015753 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:14.333566 master-0 kubenswrapper[4807]: I1014 13:35:14.332401 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ovn-northd-0" podStartSLOduration=5.881612914 podStartE2EDuration="7.332378826s" podCreationTimestamp="2025-10-14 13:35:07 +0000 UTC" firstStartedPulling="2025-10-14 13:35:09.339750366 +0000 UTC m=+904.021052210" lastFinishedPulling="2025-10-14 13:35:10.790516308 +0000 UTC m=+905.471818122" observedRunningTime="2025-10-14 13:35:13.735615748 +0000 UTC m=+908.416917572" watchObservedRunningTime="2025-10-14 13:35:14.332378826 +0000 UTC m=+909.013680650" Oct 14 13:35:14.335265 master-0 kubenswrapper[4807]: I1014 13:35:14.335229 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/swift-storage-0"] Oct 14 13:35:14.339810 master-0 kubenswrapper[4807]: I1014 13:35:14.339763 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Oct 14 13:35:14.343482 master-0 kubenswrapper[4807]: I1014 13:35:14.343405 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-ring-files" Oct 14 13:35:14.343850 master-0 kubenswrapper[4807]: I1014 13:35:14.343821 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"swift-conf" Oct 14 13:35:14.344179 master-0 kubenswrapper[4807]: I1014 13:35:14.344149 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"swift-storage-config-data" Oct 14 13:35:14.366856 master-0 kubenswrapper[4807]: I1014 13:35:14.366791 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Oct 14 13:35:14.458806 master-0 kubenswrapper[4807]: E1014 13:35:14.458741 4807 desired_state_of_world_populator.go:313] "Error processing volume" err="error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" volumeName="swift" Oct 14 13:35:14.465312 master-0 kubenswrapper[4807]: I1014 13:35:14.465219 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.465529 master-0 kubenswrapper[4807]: I1014 13:35:14.465357 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-lock\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.465529 master-0 kubenswrapper[4807]: I1014 13:35:14.465422 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-cache\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.465529 master-0 kubenswrapper[4807]: I1014 13:35:14.465481 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whcvm\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-kube-api-access-whcvm\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.567235 master-0 kubenswrapper[4807]: I1014 13:35:14.567141 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-lock\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.567235 master-0 kubenswrapper[4807]: I1014 13:35:14.567228 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-cache\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.567621 master-0 kubenswrapper[4807]: I1014 13:35:14.567273 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-whcvm\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-kube-api-access-whcvm\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.567621 master-0 kubenswrapper[4807]: I1014 13:35:14.567321 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.567621 master-0 kubenswrapper[4807]: E1014 13:35:14.567500 4807 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Oct 14 13:35:14.567621 master-0 kubenswrapper[4807]: E1014 13:35:14.567516 4807 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Oct 14 13:35:14.567621 master-0 kubenswrapper[4807]: E1014 13:35:14.567563 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift podName:68fbeea1-cbf0-44b7-a159-08369455b5e6 nodeName:}" failed. No retries permitted until 2025-10-14 13:35:15.06754629 +0000 UTC m=+909.748848114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift") pod "swift-storage-0" (UID: "68fbeea1-cbf0-44b7-a159-08369455b5e6") : configmap "swift-ring-files" not found Oct 14 13:35:14.567933 master-0 kubenswrapper[4807]: I1014 13:35:14.567830 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"cache\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-cache\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.568304 master-0 kubenswrapper[4807]: I1014 13:35:14.568240 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lock\" (UniqueName: \"kubernetes.io/empty-dir/68fbeea1-cbf0-44b7-a159-08369455b5e6-lock\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.597328 master-0 kubenswrapper[4807]: I1014 13:35:14.597177 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-whcvm\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-kube-api-access-whcvm\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:14.660750 master-0 kubenswrapper[4807]: E1014 13:35:14.660647 4807 kubelet.go:1946] "Unable to attach or mount volumes for pod; skipping pod" err="unmounted volumes=[etc-swift swift], unattached volumes=[], failed to process volumes=[swift]: error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" Oct 14 13:35:14.660750 master-0 kubenswrapper[4807]: E1014 13:35:14.660717 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[etc-swift swift], unattached volumes=[], failed to process volumes=[swift]: error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" podUID="68fbeea1-cbf0-44b7-a159-08369455b5e6" Oct 14 13:35:14.781723 master-0 kubenswrapper[4807]: I1014 13:35:14.781660 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-db-create-k8c9r"] Oct 14 13:35:14.783872 master-0 kubenswrapper[4807]: I1014 13:35:14.783837 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:14.798145 master-0 kubenswrapper[4807]: I1014 13:35:14.798095 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-k8c9r"] Oct 14 13:35:14.873031 master-0 kubenswrapper[4807]: I1014 13:35:14.872941 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmq4h\" (UniqueName: \"kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h\") pod \"glance-db-create-k8c9r\" (UID: \"24f7d4f6-6841-4767-9319-872ca9839498\") " pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:14.975342 master-0 kubenswrapper[4807]: I1014 13:35:14.975231 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pmq4h\" (UniqueName: \"kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h\") pod \"glance-db-create-k8c9r\" (UID: \"24f7d4f6-6841-4767-9319-872ca9839498\") " pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:14.994865 master-0 kubenswrapper[4807]: I1014 13:35:14.994791 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmq4h\" (UniqueName: \"kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h\") pod \"glance-db-create-k8c9r\" (UID: \"24f7d4f6-6841-4767-9319-872ca9839498\") " pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:15.022528 master-0 kubenswrapper[4807]: I1014 13:35:15.022329 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Oct 14 13:35:15.076416 master-0 kubenswrapper[4807]: E1014 13:35:15.076321 4807 desired_state_of_world_populator.go:313] "Error processing volume" err="error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" volumeName="swift" Oct 14 13:35:15.077497 master-0 kubenswrapper[4807]: I1014 13:35:15.077254 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:15.077700 master-0 kubenswrapper[4807]: E1014 13:35:15.077615 4807 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Oct 14 13:35:15.077700 master-0 kubenswrapper[4807]: E1014 13:35:15.077648 4807 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Oct 14 13:35:15.077800 master-0 kubenswrapper[4807]: E1014 13:35:15.077712 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift podName:68fbeea1-cbf0-44b7-a159-08369455b5e6 nodeName:}" failed. No retries permitted until 2025-10-14 13:35:16.077690879 +0000 UTC m=+910.758992793 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift") pod "swift-storage-0" (UID: "68fbeea1-cbf0-44b7-a159-08369455b5e6") : configmap "swift-ring-files" not found Oct 14 13:35:15.094162 master-0 kubenswrapper[4807]: I1014 13:35:15.094091 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/ovn-controller-x94kc" podUID="b4cb48f3-4205-4214-83fd-fa3ae7077a61" containerName="ovn-controller" probeResult="failure" output=< Oct 14 13:35:15.094162 master-0 kubenswrapper[4807]: ERROR - ovn-controller connection status is 'not connected', expecting 'connected' status Oct 14 13:35:15.094162 master-0 kubenswrapper[4807]: > Oct 14 13:35:15.124028 master-0 kubenswrapper[4807]: I1014 13:35:15.123855 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:15.324665 master-0 kubenswrapper[4807]: E1014 13:35:15.324605 4807 kubelet.go:1946] "Unable to attach or mount volumes for pod; skipping pod" err="unmounted volumes=[etc-swift swift], unattached volumes=[], failed to process volumes=[swift]: error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" Oct 14 13:35:15.324962 master-0 kubenswrapper[4807]: E1014 13:35:15.324933 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[etc-swift swift], unattached volumes=[], failed to process volumes=[swift]: error processing PVC openstack/swift-swift-storage-0: PVC is not bound" pod="openstack/swift-storage-0" podUID="68fbeea1-cbf0-44b7-a159-08369455b5e6" Oct 14 13:35:15.866232 master-0 kubenswrapper[4807]: I1014 13:35:15.863027 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" podStartSLOduration=6.862994957 podStartE2EDuration="6.862994957s" podCreationTimestamp="2025-10-14 13:35:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:35:14.878294623 +0000 UTC m=+909.559596477" watchObservedRunningTime="2025-10-14 13:35:15.862994957 +0000 UTC m=+910.544296821" Oct 14 13:35:15.895500 master-0 kubenswrapper[4807]: I1014 13:35:15.892127 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-db-create-k8c9r"] Oct 14 13:35:16.064438 master-0 kubenswrapper[4807]: W1014 13:35:16.063673 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24f7d4f6_6841_4767_9319_872ca9839498.slice/crio-c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42 WatchSource:0}: Error finding container c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42: Status 404 returned error can't find the container with id c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42 Oct 14 13:35:16.098048 master-0 kubenswrapper[4807]: I1014 13:35:16.097480 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:16.098048 master-0 kubenswrapper[4807]: E1014 13:35:16.097915 4807 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Oct 14 13:35:16.098048 master-0 kubenswrapper[4807]: E1014 13:35:16.097946 4807 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Oct 14 13:35:16.098048 master-0 kubenswrapper[4807]: E1014 13:35:16.098014 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift podName:68fbeea1-cbf0-44b7-a159-08369455b5e6 nodeName:}" failed. No retries permitted until 2025-10-14 13:35:18.097993266 +0000 UTC m=+912.779295080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift") pod "swift-storage-0" (UID: "68fbeea1-cbf0-44b7-a159-08369455b5e6") : configmap "swift-ring-files" not found Oct 14 13:35:16.273409 master-0 kubenswrapper[4807]: I1014 13:35:16.273327 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/prometheus-metric-storage-0" podStartSLOduration=31.645699518 podStartE2EDuration="57.273296723s" podCreationTimestamp="2025-10-14 13:34:19 +0000 UTC" firstStartedPulling="2025-10-14 13:34:47.476581228 +0000 UTC m=+882.157883052" lastFinishedPulling="2025-10-14 13:35:13.104178433 +0000 UTC m=+907.785480257" observedRunningTime="2025-10-14 13:35:16.234632844 +0000 UTC m=+910.915934678" watchObservedRunningTime="2025-10-14 13:35:16.273296723 +0000 UTC m=+910.954598547" Oct 14 13:35:16.395557 master-0 kubenswrapper[4807]: I1014 13:35:16.395473 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ovn-controller-x94kc-config-tw7d6"] Oct 14 13:35:16.396700 master-0 kubenswrapper[4807]: I1014 13:35:16.396653 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.399768 master-0 kubenswrapper[4807]: I1014 13:35:16.399676 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovncontroller-extra-scripts" Oct 14 13:35:16.432874 master-0 kubenswrapper[4807]: I1014 13:35:16.432691 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-x94kc-config-tw7d6"] Oct 14 13:35:16.449117 master-0 kubenswrapper[4807]: I1014 13:35:16.449035 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-db-create-mvgwz"] Oct 14 13:35:16.451031 master-0 kubenswrapper[4807]: I1014 13:35:16.450176 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:16.453072 master-0 kubenswrapper[4807]: I1014 13:35:16.453012 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-mvgwz"] Oct 14 13:35:16.504646 master-0 kubenswrapper[4807]: I1014 13:35:16.504578 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.505028 master-0 kubenswrapper[4807]: I1014 13:35:16.505013 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.505126 master-0 kubenswrapper[4807]: I1014 13:35:16.505107 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqf9\" (UniqueName: \"kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9\") pod \"keystone-db-create-mvgwz\" (UID: \"2e741407-a04b-4ac8-aee7-16c7106b1922\") " pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:16.505213 master-0 kubenswrapper[4807]: I1014 13:35:16.505201 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28fx5\" (UniqueName: \"kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.505370 master-0 kubenswrapper[4807]: I1014 13:35:16.505358 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.505498 master-0 kubenswrapper[4807]: I1014 13:35:16.505475 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.505624 master-0 kubenswrapper[4807]: I1014 13:35:16.505609 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.579080 master-0 kubenswrapper[4807]: I1014 13:35:16.578947 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-db-create-md9ws"] Oct 14 13:35:16.599125 master-0 kubenswrapper[4807]: I1014 13:35:16.599028 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-md9ws"] Oct 14 13:35:16.632771 master-0 kubenswrapper[4807]: I1014 13:35:16.631607 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-md9ws" Oct 14 13:35:16.637802 master-0 kubenswrapper[4807]: I1014 13:35:16.637746 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-28fx5\" (UniqueName: \"kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638159 master-0 kubenswrapper[4807]: I1014 13:35:16.638127 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638202 master-0 kubenswrapper[4807]: I1014 13:35:16.638173 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638286 master-0 kubenswrapper[4807]: I1014 13:35:16.638260 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638418 master-0 kubenswrapper[4807]: I1014 13:35:16.638395 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638490 master-0 kubenswrapper[4807]: I1014 13:35:16.638472 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638537 master-0 kubenswrapper[4807]: I1014 13:35:16.638504 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638676 master-0 kubenswrapper[4807]: I1014 13:35:16.638648 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.638723 master-0 kubenswrapper[4807]: I1014 13:35:16.638697 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.640679 master-0 kubenswrapper[4807]: I1014 13:35:16.640645 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.640760 master-0 kubenswrapper[4807]: I1014 13:35:16.640720 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqf9\" (UniqueName: \"kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9\") pod \"keystone-db-create-mvgwz\" (UID: \"2e741407-a04b-4ac8-aee7-16c7106b1922\") " pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:16.641810 master-0 kubenswrapper[4807]: I1014 13:35:16.641647 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.713272 master-0 kubenswrapper[4807]: I1014 13:35:16.713138 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-28fx5\" (UniqueName: \"kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5\") pod \"ovn-controller-x94kc-config-tw7d6\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.717340 master-0 kubenswrapper[4807]: I1014 13:35:16.717279 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqf9\" (UniqueName: \"kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9\") pod \"keystone-db-create-mvgwz\" (UID: \"2e741407-a04b-4ac8-aee7-16c7106b1922\") " pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:16.742883 master-0 kubenswrapper[4807]: I1014 13:35:16.742797 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw4mx\" (UniqueName: \"kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx\") pod \"placement-db-create-md9ws\" (UID: \"a796f380-0a4b-490f-a260-e65b306cfd6a\") " pod="openstack/placement-db-create-md9ws" Oct 14 13:35:16.770820 master-0 kubenswrapper[4807]: I1014 13:35:16.770728 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:16.776809 master-0 kubenswrapper[4807]: I1014 13:35:16.776758 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:16.845114 master-0 kubenswrapper[4807]: I1014 13:35:16.845042 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-pw4mx\" (UniqueName: \"kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx\") pod \"placement-db-create-md9ws\" (UID: \"a796f380-0a4b-490f-a260-e65b306cfd6a\") " pod="openstack/placement-db-create-md9ws" Oct 14 13:35:16.881371 master-0 kubenswrapper[4807]: I1014 13:35:16.880769 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw4mx\" (UniqueName: \"kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx\") pod \"placement-db-create-md9ws\" (UID: \"a796f380-0a4b-490f-a260-e65b306cfd6a\") " pod="openstack/placement-db-create-md9ws" Oct 14 13:35:16.912699 master-0 kubenswrapper[4807]: I1014 13:35:16.911216 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:16.912699 master-0 kubenswrapper[4807]: I1014 13:35:16.912639 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:16.917202 master-0 kubenswrapper[4807]: I1014 13:35:16.917022 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:16.959159 master-0 kubenswrapper[4807]: I1014 13:35:16.959077 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-md9ws" Oct 14 13:35:17.038244 master-0 kubenswrapper[4807]: I1014 13:35:17.038180 4807 generic.go:334] "Generic (PLEG): container finished" podID="24f7d4f6-6841-4767-9319-872ca9839498" containerID="5d91cad0267ed1d36ca2b7776d42f3059a9b068dc4fa9e739f1ca396647d7e6d" exitCode=0 Oct 14 13:35:17.038548 master-0 kubenswrapper[4807]: I1014 13:35:17.038348 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-k8c9r" event={"ID":"24f7d4f6-6841-4767-9319-872ca9839498","Type":"ContainerDied","Data":"5d91cad0267ed1d36ca2b7776d42f3059a9b068dc4fa9e739f1ca396647d7e6d"} Oct 14 13:35:17.038548 master-0 kubenswrapper[4807]: I1014 13:35:17.038472 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-k8c9r" event={"ID":"24f7d4f6-6841-4767-9319-872ca9839498","Type":"ContainerStarted","Data":"c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42"} Oct 14 13:35:17.041853 master-0 kubenswrapper[4807]: I1014 13:35:17.041815 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:17.306992 master-0 kubenswrapper[4807]: I1014 13:35:17.306720 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ovn-controller-x94kc-config-tw7d6"] Oct 14 13:35:17.320380 master-0 kubenswrapper[4807]: W1014 13:35:17.311276 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6dd428a_aa03_4bee_9c8e_c13df30047c7.slice/crio-188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8 WatchSource:0}: Error finding container 188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8: Status 404 returned error can't find the container with id 188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8 Oct 14 13:35:17.391785 master-0 kubenswrapper[4807]: I1014 13:35:17.391710 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-db-create-mvgwz"] Oct 14 13:35:17.488363 master-0 kubenswrapper[4807]: I1014 13:35:17.486250 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-db-create-md9ws"] Oct 14 13:35:17.490209 master-0 kubenswrapper[4807]: W1014 13:35:17.490142 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda796f380_0a4b_490f_a260_e65b306cfd6a.slice/crio-7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba WatchSource:0}: Error finding container 7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba: Status 404 returned error can't find the container with id 7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba Oct 14 13:35:17.521231 master-0 kubenswrapper[4807]: E1014 13:35:17.521136 4807 upgradeaware.go:427] Error proxying data from client to backend: readfrom tcp 192.168.34.10:37524->192.168.34.10:45745: write tcp 192.168.34.10:37524->192.168.34.10:45745: write: broken pipe Oct 14 13:35:17.561731 master-0 kubenswrapper[4807]: I1014 13:35:17.561630 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-server-0" Oct 14 13:35:18.049629 master-0 kubenswrapper[4807]: I1014 13:35:18.049206 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-mvgwz" event={"ID":"2e741407-a04b-4ac8-aee7-16c7106b1922","Type":"ContainerStarted","Data":"8f768448c6681b11cce06c92a27a2d5ba4b5c67da02179c60062a27c219b7582"} Oct 14 13:35:18.049629 master-0 kubenswrapper[4807]: I1014 13:35:18.049272 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-mvgwz" event={"ID":"2e741407-a04b-4ac8-aee7-16c7106b1922","Type":"ContainerStarted","Data":"92a617a13ed629548b9446df8ccad7d826fbfb33acea01552f8fcb87a0414774"} Oct 14 13:35:18.056950 master-0 kubenswrapper[4807]: I1014 13:35:18.056900 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-md9ws" event={"ID":"a796f380-0a4b-490f-a260-e65b306cfd6a","Type":"ContainerStarted","Data":"19b5d872c486fd813ccd1358e31b1acec5668a2eb10c5ed345b9428f18054512"} Oct 14 13:35:18.056950 master-0 kubenswrapper[4807]: I1014 13:35:18.056954 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-md9ws" event={"ID":"a796f380-0a4b-490f-a260-e65b306cfd6a","Type":"ContainerStarted","Data":"7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba"} Oct 14 13:35:18.063098 master-0 kubenswrapper[4807]: I1014 13:35:18.063033 4807 generic.go:334] "Generic (PLEG): container finished" podID="d6dd428a-aa03-4bee-9c8e-c13df30047c7" containerID="154e045c44b233e12ac1b09369f24ce2b30cb6442f6e9d8fb99bfc713cd0b3fe" exitCode=0 Oct 14 13:35:18.064215 master-0 kubenswrapper[4807]: I1014 13:35:18.064175 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-x94kc-config-tw7d6" event={"ID":"d6dd428a-aa03-4bee-9c8e-c13df30047c7","Type":"ContainerDied","Data":"154e045c44b233e12ac1b09369f24ce2b30cb6442f6e9d8fb99bfc713cd0b3fe"} Oct 14 13:35:18.064215 master-0 kubenswrapper[4807]: I1014 13:35:18.064212 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-x94kc-config-tw7d6" event={"ID":"d6dd428a-aa03-4bee-9c8e-c13df30047c7","Type":"ContainerStarted","Data":"188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8"} Oct 14 13:35:18.082004 master-0 kubenswrapper[4807]: I1014 13:35:18.081900 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-db-create-mvgwz" podStartSLOduration=2.081875963 podStartE2EDuration="2.081875963s" podCreationTimestamp="2025-10-14 13:35:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:35:18.080557015 +0000 UTC m=+912.761858859" watchObservedRunningTime="2025-10-14 13:35:18.081875963 +0000 UTC m=+912.763177787" Oct 14 13:35:18.110982 master-0 kubenswrapper[4807]: I1014 13:35:18.110771 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-db-create-md9ws" podStartSLOduration=2.110748086 podStartE2EDuration="2.110748086s" podCreationTimestamp="2025-10-14 13:35:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:35:18.106814955 +0000 UTC m=+912.788116779" watchObservedRunningTime="2025-10-14 13:35:18.110748086 +0000 UTC m=+912.792049900" Oct 14 13:35:18.179035 master-0 kubenswrapper[4807]: I1014 13:35:18.178965 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:18.179416 master-0 kubenswrapper[4807]: E1014 13:35:18.179346 4807 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Oct 14 13:35:18.179416 master-0 kubenswrapper[4807]: E1014 13:35:18.179406 4807 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Oct 14 13:35:18.179643 master-0 kubenswrapper[4807]: E1014 13:35:18.179486 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift podName:68fbeea1-cbf0-44b7-a159-08369455b5e6 nodeName:}" failed. No retries permitted until 2025-10-14 13:35:22.179448391 +0000 UTC m=+916.860750215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift") pod "swift-storage-0" (UID: "68fbeea1-cbf0-44b7-a159-08369455b5e6") : configmap "swift-ring-files" not found Oct 14 13:35:18.461022 master-0 kubenswrapper[4807]: I1014 13:35:18.460964 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:18.587895 master-0 kubenswrapper[4807]: I1014 13:35:18.587814 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pmq4h\" (UniqueName: \"kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h\") pod \"24f7d4f6-6841-4767-9319-872ca9839498\" (UID: \"24f7d4f6-6841-4767-9319-872ca9839498\") " Oct 14 13:35:18.591477 master-0 kubenswrapper[4807]: I1014 13:35:18.591422 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h" (OuterVolumeSpecName: "kube-api-access-pmq4h") pod "24f7d4f6-6841-4767-9319-872ca9839498" (UID: "24f7d4f6-6841-4767-9319-872ca9839498"). InnerVolumeSpecName "kube-api-access-pmq4h". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:18.690528 master-0 kubenswrapper[4807]: I1014 13:35:18.690424 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pmq4h\" (UniqueName: \"kubernetes.io/projected/24f7d4f6-6841-4767-9319-872ca9839498-kube-api-access-pmq4h\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.077624 master-0 kubenswrapper[4807]: I1014 13:35:19.077395 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-db-create-k8c9r" event={"ID":"24f7d4f6-6841-4767-9319-872ca9839498","Type":"ContainerDied","Data":"c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42"} Oct 14 13:35:19.077624 master-0 kubenswrapper[4807]: I1014 13:35:19.077450 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c0e7ed6d1e56197572d30b2fe56f80ef004c8de3f7a957b4bab39fee89ee6f42" Oct 14 13:35:19.077624 master-0 kubenswrapper[4807]: I1014 13:35:19.077496 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-db-create-k8c9r" Oct 14 13:35:19.079908 master-0 kubenswrapper[4807]: I1014 13:35:19.079859 4807 generic.go:334] "Generic (PLEG): container finished" podID="2e741407-a04b-4ac8-aee7-16c7106b1922" containerID="8f768448c6681b11cce06c92a27a2d5ba4b5c67da02179c60062a27c219b7582" exitCode=0 Oct 14 13:35:19.079988 master-0 kubenswrapper[4807]: I1014 13:35:19.079949 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-mvgwz" event={"ID":"2e741407-a04b-4ac8-aee7-16c7106b1922","Type":"ContainerDied","Data":"8f768448c6681b11cce06c92a27a2d5ba4b5c67da02179c60062a27c219b7582"} Oct 14 13:35:19.084171 master-0 kubenswrapper[4807]: I1014 13:35:19.084032 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-md9ws" event={"ID":"a796f380-0a4b-490f-a260-e65b306cfd6a","Type":"ContainerDied","Data":"19b5d872c486fd813ccd1358e31b1acec5668a2eb10c5ed345b9428f18054512"} Oct 14 13:35:19.085008 master-0 kubenswrapper[4807]: I1014 13:35:19.084960 4807 generic.go:334] "Generic (PLEG): container finished" podID="a796f380-0a4b-490f-a260-e65b306cfd6a" containerID="19b5d872c486fd813ccd1358e31b1acec5668a2eb10c5ed345b9428f18054512" exitCode=0 Oct 14 13:35:19.469910 master-0 kubenswrapper[4807]: I1014 13:35:19.469851 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:19.597768 master-0 kubenswrapper[4807]: I1014 13:35:19.596586 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-galera-0" Oct 14 13:35:19.613415 master-0 kubenswrapper[4807]: I1014 13:35:19.613374 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.613734 master-0 kubenswrapper[4807]: I1014 13:35:19.613533 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28fx5\" (UniqueName: \"kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.613734 master-0 kubenswrapper[4807]: I1014 13:35:19.613662 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.613734 master-0 kubenswrapper[4807]: I1014 13:35:19.613691 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.613734 master-0 kubenswrapper[4807]: I1014 13:35:19.613713 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.613913 master-0 kubenswrapper[4807]: I1014 13:35:19.613795 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts\") pod \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\" (UID: \"d6dd428a-aa03-4bee-9c8e-c13df30047c7\") " Oct 14 13:35:19.614684 master-0 kubenswrapper[4807]: I1014 13:35:19.614605 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run" (OuterVolumeSpecName: "var-run") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "var-run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:35:19.614764 master-0 kubenswrapper[4807]: I1014 13:35:19.614735 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn" (OuterVolumeSpecName: "var-log-ovn") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "var-log-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:35:19.615957 master-0 kubenswrapper[4807]: I1014 13:35:19.615381 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts" (OuterVolumeSpecName: "additional-scripts") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "additional-scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:35:19.615957 master-0 kubenswrapper[4807]: I1014 13:35:19.615590 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts" (OuterVolumeSpecName: "scripts") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:35:19.615957 master-0 kubenswrapper[4807]: I1014 13:35:19.615855 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn" (OuterVolumeSpecName: "var-run-ovn") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "var-run-ovn". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:35:19.620968 master-0 kubenswrapper[4807]: I1014 13:35:19.620900 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5" (OuterVolumeSpecName: "kube-api-access-28fx5") pod "d6dd428a-aa03-4bee-9c8e-c13df30047c7" (UID: "d6dd428a-aa03-4bee-9c8e-c13df30047c7"). InnerVolumeSpecName "kube-api-access-28fx5". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:19.646703 master-0 kubenswrapper[4807]: I1014 13:35:19.646650 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-galera-0" Oct 14 13:35:19.715980 master-0 kubenswrapper[4807]: I1014 13:35:19.715864 4807 reconciler_common.go:293] "Volume detached for volume \"additional-scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-additional-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.716267 master-0 kubenswrapper[4807]: I1014 13:35:19.716223 4807 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/configmap/d6dd428a-aa03-4bee-9c8e-c13df30047c7-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.716337 master-0 kubenswrapper[4807]: I1014 13:35:19.716272 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-28fx5\" (UniqueName: \"kubernetes.io/projected/d6dd428a-aa03-4bee-9c8e-c13df30047c7-kube-api-access-28fx5\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.716337 master-0 kubenswrapper[4807]: I1014 13:35:19.716287 4807 reconciler_common.go:293] "Volume detached for volume \"var-run-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run-ovn\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.716337 master-0 kubenswrapper[4807]: I1014 13:35:19.716300 4807 reconciler_common.go:293] "Volume detached for volume \"var-run\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-run\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.716337 master-0 kubenswrapper[4807]: I1014 13:35:19.716313 4807 reconciler_common.go:293] "Volume detached for volume \"var-log-ovn\" (UniqueName: \"kubernetes.io/host-path/d6dd428a-aa03-4bee-9c8e-c13df30047c7-var-log-ovn\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:19.777556 master-0 kubenswrapper[4807]: I1014 13:35:19.775792 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:35:20.089171 master-0 kubenswrapper[4807]: I1014 13:35:20.089094 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-controller-x94kc" Oct 14 13:35:20.098743 master-0 kubenswrapper[4807]: I1014 13:35:20.098672 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ovn-controller-x94kc-config-tw7d6" event={"ID":"d6dd428a-aa03-4bee-9c8e-c13df30047c7","Type":"ContainerDied","Data":"188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8"} Oct 14 13:35:20.098853 master-0 kubenswrapper[4807]: I1014 13:35:20.098744 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="188c2a3c8fe661bbd30e50cdac778627a7df2cc0b3474d0300e3d0c7b23aede8" Oct 14 13:35:20.099064 master-0 kubenswrapper[4807]: I1014 13:35:20.099012 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ovn-controller-x94kc-config-tw7d6" Oct 14 13:35:20.578111 master-0 kubenswrapper[4807]: I1014 13:35:20.578050 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-md9ws" Oct 14 13:35:20.639608 master-0 kubenswrapper[4807]: I1014 13:35:20.639555 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw4mx\" (UniqueName: \"kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx\") pod \"a796f380-0a4b-490f-a260-e65b306cfd6a\" (UID: \"a796f380-0a4b-490f-a260-e65b306cfd6a\") " Oct 14 13:35:20.644870 master-0 kubenswrapper[4807]: I1014 13:35:20.644825 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx" (OuterVolumeSpecName: "kube-api-access-pw4mx") pod "a796f380-0a4b-490f-a260-e65b306cfd6a" (UID: "a796f380-0a4b-490f-a260-e65b306cfd6a"). InnerVolumeSpecName "kube-api-access-pw4mx". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:20.668024 master-0 kubenswrapper[4807]: I1014 13:35:20.667914 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ovn-controller-x94kc-config-tw7d6"] Oct 14 13:35:20.677930 master-0 kubenswrapper[4807]: I1014 13:35:20.677863 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ovn-controller-x94kc-config-tw7d6"] Oct 14 13:35:20.711501 master-0 kubenswrapper[4807]: I1014 13:35:20.711449 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:20.743238 master-0 kubenswrapper[4807]: I1014 13:35:20.743153 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-pw4mx\" (UniqueName: \"kubernetes.io/projected/a796f380-0a4b-490f-a260-e65b306cfd6a-kube-api-access-pw4mx\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:20.777603 master-0 kubenswrapper[4807]: I1014 13:35:20.777533 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/rabbitmq-cell1-server-0" Oct 14 13:35:20.945753 master-0 kubenswrapper[4807]: I1014 13:35:20.945621 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbqf9\" (UniqueName: \"kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9\") pod \"2e741407-a04b-4ac8-aee7-16c7106b1922\" (UID: \"2e741407-a04b-4ac8-aee7-16c7106b1922\") " Oct 14 13:35:20.951079 master-0 kubenswrapper[4807]: I1014 13:35:20.950340 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9" (OuterVolumeSpecName: "kube-api-access-kbqf9") pod "2e741407-a04b-4ac8-aee7-16c7106b1922" (UID: "2e741407-a04b-4ac8-aee7-16c7106b1922"). InnerVolumeSpecName "kube-api-access-kbqf9". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:21.049202 master-0 kubenswrapper[4807]: I1014 13:35:21.049109 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-kbqf9\" (UniqueName: \"kubernetes.io/projected/2e741407-a04b-4ac8-aee7-16c7106b1922-kube-api-access-kbqf9\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:21.115924 master-0 kubenswrapper[4807]: I1014 13:35:21.115864 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-db-create-mvgwz" event={"ID":"2e741407-a04b-4ac8-aee7-16c7106b1922","Type":"ContainerDied","Data":"92a617a13ed629548b9446df8ccad7d826fbfb33acea01552f8fcb87a0414774"} Oct 14 13:35:21.115924 master-0 kubenswrapper[4807]: I1014 13:35:21.115920 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-db-create-mvgwz" Oct 14 13:35:21.116265 master-0 kubenswrapper[4807]: I1014 13:35:21.115924 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92a617a13ed629548b9446df8ccad7d826fbfb33acea01552f8fcb87a0414774" Oct 14 13:35:21.121168 master-0 kubenswrapper[4807]: I1014 13:35:21.121110 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-db-create-md9ws" event={"ID":"a796f380-0a4b-490f-a260-e65b306cfd6a","Type":"ContainerDied","Data":"7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba"} Oct 14 13:35:21.121168 master-0 kubenswrapper[4807]: I1014 13:35:21.121166 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bd790473d78eaf540553a5ef5057744d7b602e69c830f1690deaf46e10182ba" Oct 14 13:35:21.121381 master-0 kubenswrapper[4807]: I1014 13:35:21.121202 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-db-create-md9ws" Oct 14 13:35:21.747856 master-0 kubenswrapper[4807]: I1014 13:35:21.747787 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/openstack-cell1-galera-0" Oct 14 13:35:21.808331 master-0 kubenswrapper[4807]: I1014 13:35:21.808258 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/openstack-cell1-galera-0" Oct 14 13:35:22.057151 master-0 kubenswrapper[4807]: I1014 13:35:22.057056 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:22.057681 master-0 kubenswrapper[4807]: I1014 13:35:22.057551 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/prometheus-metric-storage-0" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="prometheus" containerID="cri-o://f452ef707be015c051014ebbed79d626132ab7be5903d6179d9ce81b7160f330" gracePeriod=600 Oct 14 13:35:22.057816 master-0 kubenswrapper[4807]: I1014 13:35:22.057711 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/prometheus-metric-storage-0" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="config-reloader" containerID="cri-o://81da5068d73284bec2acdbe49db063e23ed78ab9029a1e924b2cf0da438f1fd5" gracePeriod=600 Oct 14 13:35:22.057941 master-0 kubenswrapper[4807]: I1014 13:35:22.057697 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/prometheus-metric-storage-0" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="thanos-sidecar" containerID="cri-o://f129ba3b234a24a9377030e5d280eb222b6ed607d0ee5fac0648abbb7a7c8f50" gracePeriod=600 Oct 14 13:35:22.271157 master-0 kubenswrapper[4807]: I1014 13:35:22.271077 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:22.271483 master-0 kubenswrapper[4807]: E1014 13:35:22.271410 4807 projected.go:288] Couldn't get configMap openstack/swift-ring-files: configmap "swift-ring-files" not found Oct 14 13:35:22.271483 master-0 kubenswrapper[4807]: E1014 13:35:22.271480 4807 projected.go:194] Error preparing data for projected volume etc-swift for pod openstack/swift-storage-0: configmap "swift-ring-files" not found Oct 14 13:35:22.271610 master-0 kubenswrapper[4807]: E1014 13:35:22.271584 4807 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift podName:68fbeea1-cbf0-44b7-a159-08369455b5e6 nodeName:}" failed. No retries permitted until 2025-10-14 13:35:30.271542457 +0000 UTC m=+924.952844481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "etc-swift" (UniqueName: "kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift") pod "swift-storage-0" (UID: "68fbeea1-cbf0-44b7-a159-08369455b5e6") : configmap "swift-ring-files" not found Oct 14 13:35:22.273838 master-0 kubenswrapper[4807]: I1014 13:35:22.273517 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6dd428a-aa03-4bee-9c8e-c13df30047c7" path="/var/lib/kubelet/pods/d6dd428a-aa03-4bee-9c8e-c13df30047c7/volumes" Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139269 4807 generic.go:334] "Generic (PLEG): container finished" podID="defbed72-be31-4758-926e-70192a138b0a" containerID="f129ba3b234a24a9377030e5d280eb222b6ed607d0ee5fac0648abbb7a7c8f50" exitCode=0 Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139307 4807 generic.go:334] "Generic (PLEG): container finished" podID="defbed72-be31-4758-926e-70192a138b0a" containerID="81da5068d73284bec2acdbe49db063e23ed78ab9029a1e924b2cf0da438f1fd5" exitCode=0 Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139315 4807 generic.go:334] "Generic (PLEG): container finished" podID="defbed72-be31-4758-926e-70192a138b0a" containerID="f452ef707be015c051014ebbed79d626132ab7be5903d6179d9ce81b7160f330" exitCode=0 Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139331 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerDied","Data":"f129ba3b234a24a9377030e5d280eb222b6ed607d0ee5fac0648abbb7a7c8f50"} Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139416 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerDied","Data":"81da5068d73284bec2acdbe49db063e23ed78ab9029a1e924b2cf0da438f1fd5"} Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139429 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerDied","Data":"f452ef707be015c051014ebbed79d626132ab7be5903d6179d9ce81b7160f330"} Oct 14 13:35:23.139388 master-0 kubenswrapper[4807]: I1014 13:35:23.139440 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"defbed72-be31-4758-926e-70192a138b0a","Type":"ContainerDied","Data":"b3dcb0b3866b44c4f06b99432de11f18427bc76f6b0b44e1b48f8025bf54c8fc"} Oct 14 13:35:23.141062 master-0 kubenswrapper[4807]: I1014 13:35:23.139452 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3dcb0b3866b44c4f06b99432de11f18427bc76f6b0b44e1b48f8025bf54c8fc" Oct 14 13:35:23.153808 master-0 kubenswrapper[4807]: I1014 13:35:23.153749 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:23.292055 master-0 kubenswrapper[4807]: I1014 13:35:23.292022 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.292313 master-0 kubenswrapper[4807]: I1014 13:35:23.292295 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.292798 master-0 kubenswrapper[4807]: I1014 13:35:23.292782 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.292943 master-0 kubenswrapper[4807]: I1014 13:35:23.292912 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2zf9\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.293063 master-0 kubenswrapper[4807]: I1014 13:35:23.293051 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.293868 master-0 kubenswrapper[4807]: I1014 13:35:23.293546 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0" (OuterVolumeSpecName: "prometheus-metric-storage-rulefiles-0") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "prometheus-metric-storage-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:35:23.294007 master-0 kubenswrapper[4807]: I1014 13:35:23.293992 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"prometheus-metric-storage-db\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.294331 master-0 kubenswrapper[4807]: I1014 13:35:23.294315 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.294444 master-0 kubenswrapper[4807]: I1014 13:35:23.294432 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config\") pod \"defbed72-be31-4758-926e-70192a138b0a\" (UID: \"defbed72-be31-4758-926e-70192a138b0a\") " Oct 14 13:35:23.295188 master-0 kubenswrapper[4807]: I1014 13:35:23.295167 4807 reconciler_common.go:293] "Volume detached for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/defbed72-be31-4758-926e-70192a138b0a-prometheus-metric-storage-rulefiles-0\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.296479 master-0 kubenswrapper[4807]: I1014 13:35:23.296390 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:23.298087 master-0 kubenswrapper[4807]: I1014 13:35:23.298016 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out" (OuterVolumeSpecName: "config-out") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:35:23.299307 master-0 kubenswrapper[4807]: I1014 13:35:23.299235 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:35:23.299527 master-0 kubenswrapper[4807]: I1014 13:35:23.299485 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9" (OuterVolumeSpecName: "kube-api-access-g2zf9") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "kube-api-access-g2zf9". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:23.304719 master-0 kubenswrapper[4807]: I1014 13:35:23.304675 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config" (OuterVolumeSpecName: "config") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:35:23.318252 master-0 kubenswrapper[4807]: I1014 13:35:23.318173 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config" (OuterVolumeSpecName: "web-config") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:35:23.321568 master-0 kubenswrapper[4807]: I1014 13:35:23.321497 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7" (OuterVolumeSpecName: "prometheus-metric-storage-db") pod "defbed72-be31-4758-926e-70192a138b0a" (UID: "defbed72-be31-4758-926e-70192a138b0a"). InnerVolumeSpecName "pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929". PluginName "kubernetes.io/csi", VolumeGidValue "" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.396858 4807 reconciler_common.go:293] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-tls-assets\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.396918 4807 reconciler_common.go:293] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-web-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.396942 4807 reconciler_common.go:293] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-thanos-prometheus-http-client-file\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.396959 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g2zf9\" (UniqueName: \"kubernetes.io/projected/defbed72-be31-4758-926e-70192a138b0a-kube-api-access-g2zf9\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.397014 4807 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") on node \"master-0\" " Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.397029 4807 reconciler_common.go:293] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/defbed72-be31-4758-926e-70192a138b0a-config-out\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.397219 master-0 kubenswrapper[4807]: I1014 13:35:23.397042 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/defbed72-be31-4758-926e-70192a138b0a-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.419017 master-0 kubenswrapper[4807]: I1014 13:35:23.418952 4807 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Oct 14 13:35:23.419346 master-0 kubenswrapper[4807]: I1014 13:35:23.419169 4807 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929" (UniqueName: "kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7") on node "master-0" Oct 14 13:35:23.499003 master-0 kubenswrapper[4807]: I1014 13:35:23.498949 4807 reconciler_common.go:293] "Volume detached for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:23.664055 master-0 kubenswrapper[4807]: I1014 13:35:23.663996 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ovn-northd-0" Oct 14 13:35:24.147634 master-0 kubenswrapper[4807]: I1014 13:35:24.147513 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.188864 master-0 kubenswrapper[4807]: I1014 13:35:24.188785 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:24.204987 master-0 kubenswrapper[4807]: I1014 13:35:24.204905 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:24.231301 master-0 kubenswrapper[4807]: I1014 13:35:24.231214 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:24.231631 master-0 kubenswrapper[4807]: E1014 13:35:24.231595 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d6dd428a-aa03-4bee-9c8e-c13df30047c7" containerName="ovn-config" Oct 14 13:35:24.231631 master-0 kubenswrapper[4807]: I1014 13:35:24.231613 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6dd428a-aa03-4bee-9c8e-c13df30047c7" containerName="ovn-config" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: E1014 13:35:24.231634 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="a796f380-0a4b-490f-a260-e65b306cfd6a" containerName="mariadb-database-create" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: I1014 13:35:24.231645 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="a796f380-0a4b-490f-a260-e65b306cfd6a" containerName="mariadb-database-create" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: E1014 13:35:24.231663 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="prometheus" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: I1014 13:35:24.231672 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="prometheus" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: E1014 13:35:24.231684 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="init-config-reloader" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: I1014 13:35:24.231693 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="init-config-reloader" Oct 14 13:35:24.231699 master-0 kubenswrapper[4807]: E1014 13:35:24.231704 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="2e741407-a04b-4ac8-aee7-16c7106b1922" containerName="mariadb-database-create" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: I1014 13:35:24.231713 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e741407-a04b-4ac8-aee7-16c7106b1922" containerName="mariadb-database-create" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: E1014 13:35:24.231724 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="thanos-sidecar" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: I1014 13:35:24.231733 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="thanos-sidecar" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: E1014 13:35:24.231748 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="24f7d4f6-6841-4767-9319-872ca9839498" containerName="mariadb-database-create" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: I1014 13:35:24.231756 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="24f7d4f6-6841-4767-9319-872ca9839498" containerName="mariadb-database-create" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: E1014 13:35:24.231769 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="config-reloader" Oct 14 13:35:24.231900 master-0 kubenswrapper[4807]: I1014 13:35:24.231777 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="config-reloader" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.231939 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="thanos-sidecar" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.231966 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="config-reloader" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.231977 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="a796f380-0a4b-490f-a260-e65b306cfd6a" containerName="mariadb-database-create" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.231997 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="d6dd428a-aa03-4bee-9c8e-c13df30047c7" containerName="ovn-config" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.232015 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="defbed72-be31-4758-926e-70192a138b0a" containerName="prometheus" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.232030 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="2e741407-a04b-4ac8-aee7-16c7106b1922" containerName="mariadb-database-create" Oct 14 13:35:24.232079 master-0 kubenswrapper[4807]: I1014 13:35:24.232044 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="24f7d4f6-6841-4767-9319-872ca9839498" containerName="mariadb-database-create" Oct 14 13:35:24.234054 master-0 kubenswrapper[4807]: I1014 13:35:24.233991 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.237597 master-0 kubenswrapper[4807]: I1014 13:35:24.236859 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-metric-storage-prometheus-svc" Oct 14 13:35:24.237597 master-0 kubenswrapper[4807]: I1014 13:35:24.237426 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage" Oct 14 13:35:24.237597 master-0 kubenswrapper[4807]: I1014 13:35:24.237469 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"prometheus-metric-storage-rulefiles-0" Oct 14 13:35:24.238754 master-0 kubenswrapper[4807]: I1014 13:35:24.238698 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-web-config" Oct 14 13:35:24.240041 master-0 kubenswrapper[4807]: I1014 13:35:24.239707 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-thanos-prometheus-http-client-file" Oct 14 13:35:24.265229 master-0 kubenswrapper[4807]: I1014 13:35:24.258221 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"prometheus-metric-storage-tls-assets-0" Oct 14 13:35:24.265229 master-0 kubenswrapper[4807]: I1014 13:35:24.260341 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:24.285445 master-0 kubenswrapper[4807]: I1014 13:35:24.285332 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="defbed72-be31-4758-926e-70192a138b0a" path="/var/lib/kubelet/pods/defbed72-be31-4758-926e-70192a138b0a/volumes" Oct 14 13:35:24.318322 master-0 kubenswrapper[4807]: I1014 13:35:24.318246 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318322 master-0 kubenswrapper[4807]: I1014 13:35:24.318311 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2cb06a7-0193-46d1-a0b1-d593198327b9-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318386 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318423 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318526 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318560 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318589 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2cb06a7-0193-46d1-a0b1-d593198327b9-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318657 master-0 kubenswrapper[4807]: I1014 13:35:24.318635 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318905 master-0 kubenswrapper[4807]: I1014 13:35:24.318795 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khxgc\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-kube-api-access-khxgc\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.318905 master-0 kubenswrapper[4807]: I1014 13:35:24.318842 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.319203 master-0 kubenswrapper[4807]: I1014 13:35:24.319136 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.420760 master-0 kubenswrapper[4807]: I1014 13:35:24.420673 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-khxgc\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-kube-api-access-khxgc\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.420760 master-0 kubenswrapper[4807]: I1014 13:35:24.420747 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420810 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420846 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420877 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2cb06a7-0193-46d1-a0b1-d593198327b9-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420913 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420959 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.420996 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.421025 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.421053 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2cb06a7-0193-46d1-a0b1-d593198327b9-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.421121 master-0 kubenswrapper[4807]: I1014 13:35:24.421081 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.423536 master-0 kubenswrapper[4807]: I1014 13:35:24.423074 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"prometheus-metric-storage-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2cb06a7-0193-46d1-a0b1-d593198327b9-prometheus-metric-storage-rulefiles-0\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.424049 master-0 kubenswrapper[4807]: I1014 13:35:24.424007 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:35:24.424120 master-0 kubenswrapper[4807]: I1014 13:35:24.424044 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/ffc0741878f52394f16aa241b4969439dcd9d77d9120cf853c2ff2dd6d6609ca/globalmount\"" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.431029 master-0 kubenswrapper[4807]: I1014 13:35:24.426696 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2cb06a7-0193-46d1-a0b1-d593198327b9-config-out\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.431029 master-0 kubenswrapper[4807]: I1014 13:35:24.427215 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"secret-combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-secret-combined-ca-bundle\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.431029 master-0 kubenswrapper[4807]: I1014 13:35:24.428594 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.434608 master-0 kubenswrapper[4807]: I1014 13:35:24.433995 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-thanos-prometheus-http-client-file\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.435064 master-0 kubenswrapper[4807]: I1014 13:35:24.435009 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-tls-assets\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.435939 master-0 kubenswrapper[4807]: I1014 13:35:24.435892 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-key-cert-metric-storage-promethe-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.436143 master-0 kubenswrapper[4807]: I1014 13:35:24.436115 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-config\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.441673 master-0 kubenswrapper[4807]: I1014 13:35:24.441623 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\" (UniqueName: \"kubernetes.io/secret/e2cb06a7-0193-46d1-a0b1-d593198327b9-web-config-tls-secret-cert-cert-metric-storage-prometh-dc638c2d\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:24.447725 master-0 kubenswrapper[4807]: I1014 13:35:24.447664 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-khxgc\" (UniqueName: \"kubernetes.io/projected/e2cb06a7-0193-46d1-a0b1-d593198327b9-kube-api-access-khxgc\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:25.272418 master-0 kubenswrapper[4807]: I1014 13:35:25.272300 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-9b7fb391-694c-40e0-bcaa-450dd7ce1929\" (UniqueName: \"kubernetes.io/csi/topolvm.io^7f3aeb6d-a5bb-467d-84db-482477c184b7\") pod \"prometheus-metric-storage-0\" (UID: \"e2cb06a7-0193-46d1-a0b1-d593198327b9\") " pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:25.477597 master-0 kubenswrapper[4807]: I1014 13:35:25.477377 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:26.028717 master-0 kubenswrapper[4807]: W1014 13:35:26.028607 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2cb06a7_0193_46d1_a0b1_d593198327b9.slice/crio-47afa22798f8e73d30d6024dbe11b89ed29e47c7188d273488650f3ff9eb44b0 WatchSource:0}: Error finding container 47afa22798f8e73d30d6024dbe11b89ed29e47c7188d273488650f3ff9eb44b0: Status 404 returned error can't find the container with id 47afa22798f8e73d30d6024dbe11b89ed29e47c7188d273488650f3ff9eb44b0 Oct 14 13:35:26.177953 master-0 kubenswrapper[4807]: I1014 13:35:26.177870 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerStarted","Data":"47afa22798f8e73d30d6024dbe11b89ed29e47c7188d273488650f3ff9eb44b0"} Oct 14 13:35:26.228989 master-0 kubenswrapper[4807]: I1014 13:35:26.228856 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/prometheus-metric-storage-0"] Oct 14 13:35:26.263278 master-0 kubenswrapper[4807]: I1014 13:35:26.263180 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Oct 14 13:35:26.462642 master-0 kubenswrapper[4807]: I1014 13:35:26.462553 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-0a6f2ee4-5dfc-4f99-9ed7-9d2d99599f49\" (UniqueName: \"kubernetes.io/csi/topolvm.io^41e233fb-e305-40f0-9a0d-6e1509f2a754\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:26.570133 master-0 kubenswrapper[4807]: I1014 13:35:26.570078 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-7e6f-account-create-ln8x7"] Oct 14 13:35:26.571519 master-0 kubenswrapper[4807]: I1014 13:35:26.571500 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:26.575271 master-0 kubenswrapper[4807]: I1014 13:35:26.575191 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-db-secret" Oct 14 13:35:26.587273 master-0 kubenswrapper[4807]: I1014 13:35:26.587185 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-7e6f-account-create-ln8x7"] Oct 14 13:35:26.668385 master-0 kubenswrapper[4807]: I1014 13:35:26.668336 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psphg\" (UniqueName: \"kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg\") pod \"keystone-7e6f-account-create-ln8x7\" (UID: \"f774784d-e9d4-4293-b9f7-3ce1260f1d19\") " pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:26.770032 master-0 kubenswrapper[4807]: I1014 13:35:26.769856 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-psphg\" (UniqueName: \"kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg\") pod \"keystone-7e6f-account-create-ln8x7\" (UID: \"f774784d-e9d4-4293-b9f7-3ce1260f1d19\") " pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:26.799924 master-0 kubenswrapper[4807]: I1014 13:35:26.799859 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-psphg\" (UniqueName: \"kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg\") pod \"keystone-7e6f-account-create-ln8x7\" (UID: \"f774784d-e9d4-4293-b9f7-3ce1260f1d19\") " pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:26.870747 master-0 kubenswrapper[4807]: I1014 13:35:26.870630 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-0a6f2ee4-5dfc-4f99-9ed7-9d2d99599f49\" (UniqueName: \"kubernetes.io/csi/topolvm.io^41e233fb-e305-40f0-9a0d-6e1509f2a754\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:26.873364 master-0 kubenswrapper[4807]: I1014 13:35:26.873311 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:35:26.873576 master-0 kubenswrapper[4807]: I1014 13:35:26.873369 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-0a6f2ee4-5dfc-4f99-9ed7-9d2d99599f49\" (UniqueName: \"kubernetes.io/csi/topolvm.io^41e233fb-e305-40f0-9a0d-6e1509f2a754\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/e28e7d9ceff6cd14d1c86c37c80de901326ae4f3d8f0c94ec74d70738f078329/globalmount\"" pod="openstack/swift-storage-0" Oct 14 13:35:26.894677 master-0 kubenswrapper[4807]: I1014 13:35:26.894020 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:26.958671 master-0 kubenswrapper[4807]: I1014 13:35:26.958591 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-fe87-account-create-6crd5"] Oct 14 13:35:26.960046 master-0 kubenswrapper[4807]: I1014 13:35:26.960007 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:26.965024 master-0 kubenswrapper[4807]: I1014 13:35:26.964967 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-db-secret" Oct 14 13:35:26.972802 master-0 kubenswrapper[4807]: I1014 13:35:26.972711 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvxn\" (UniqueName: \"kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn\") pod \"placement-fe87-account-create-6crd5\" (UID: \"3a38fc97-3de1-43a0-af06-748de7eea473\") " pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:26.973699 master-0 kubenswrapper[4807]: I1014 13:35:26.973633 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-fe87-account-create-6crd5"] Oct 14 13:35:27.083418 master-0 kubenswrapper[4807]: I1014 13:35:27.080237 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvxn\" (UniqueName: \"kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn\") pod \"placement-fe87-account-create-6crd5\" (UID: \"3a38fc97-3de1-43a0-af06-748de7eea473\") " pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:27.592055 master-0 kubenswrapper[4807]: I1014 13:35:27.591945 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-7e6f-account-create-ln8x7"] Oct 14 13:35:27.737027 master-0 kubenswrapper[4807]: I1014 13:35:27.736923 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvxn\" (UniqueName: \"kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn\") pod \"placement-fe87-account-create-6crd5\" (UID: \"3a38fc97-3de1-43a0-af06-748de7eea473\") " pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:27.802690 master-0 kubenswrapper[4807]: W1014 13:35:27.802583 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf774784d_e9d4_4293_b9f7_3ce1260f1d19.slice/crio-cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd WatchSource:0}: Error finding container cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd: Status 404 returned error can't find the container with id cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd Oct 14 13:35:27.885548 master-0 kubenswrapper[4807]: I1014 13:35:27.885426 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:28.199210 master-0 kubenswrapper[4807]: I1014 13:35:28.199145 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-7e6f-account-create-ln8x7" event={"ID":"f774784d-e9d4-4293-b9f7-3ce1260f1d19","Type":"ContainerStarted","Data":"cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd"} Oct 14 13:35:28.334163 master-0 kubenswrapper[4807]: I1014 13:35:28.333866 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-0a6f2ee4-5dfc-4f99-9ed7-9d2d99599f49\" (UniqueName: \"kubernetes.io/csi/topolvm.io^41e233fb-e305-40f0-9a0d-6e1509f2a754\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:28.539269 master-0 kubenswrapper[4807]: I1014 13:35:28.539114 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/barbican-db-create-6mbbn"] Oct 14 13:35:28.540696 master-0 kubenswrapper[4807]: I1014 13:35:28.540660 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:28.555693 master-0 kubenswrapper[4807]: I1014 13:35:28.555628 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/barbican-db-create-6mbbn"] Oct 14 13:35:28.579569 master-0 kubenswrapper[4807]: I1014 13:35:28.579499 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-fe87-account-create-6crd5"] Oct 14 13:35:28.580132 master-0 kubenswrapper[4807]: W1014 13:35:28.580052 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a38fc97_3de1_43a0_af06_748de7eea473.slice/crio-2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e WatchSource:0}: Error finding container 2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e: Status 404 returned error can't find the container with id 2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e Oct 14 13:35:28.638525 master-0 kubenswrapper[4807]: I1014 13:35:28.636839 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cl66\" (UniqueName: \"kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66\") pod \"barbican-db-create-6mbbn\" (UID: \"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9\") " pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:28.742065 master-0 kubenswrapper[4807]: I1014 13:35:28.741953 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7cl66\" (UniqueName: \"kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66\") pod \"barbican-db-create-6mbbn\" (UID: \"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9\") " pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:28.766697 master-0 kubenswrapper[4807]: I1014 13:35:28.765500 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cl66\" (UniqueName: \"kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66\") pod \"barbican-db-create-6mbbn\" (UID: \"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9\") " pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:28.861597 master-0 kubenswrapper[4807]: I1014 13:35:28.861521 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:29.209921 master-0 kubenswrapper[4807]: I1014 13:35:29.209855 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerStarted","Data":"70c96ee2ab9e1a087a3febd6168fb9e9832c118b220e956384a58249a3009a98"} Oct 14 13:35:29.216986 master-0 kubenswrapper[4807]: I1014 13:35:29.216234 4807 generic.go:334] "Generic (PLEG): container finished" podID="3a38fc97-3de1-43a0-af06-748de7eea473" containerID="028830a30badaddb3aa15a6214663d208297d9e369903e1ef4799c2989c99f4f" exitCode=0 Oct 14 13:35:29.216986 master-0 kubenswrapper[4807]: I1014 13:35:29.216362 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-fe87-account-create-6crd5" event={"ID":"3a38fc97-3de1-43a0-af06-748de7eea473","Type":"ContainerDied","Data":"028830a30badaddb3aa15a6214663d208297d9e369903e1ef4799c2989c99f4f"} Oct 14 13:35:29.216986 master-0 kubenswrapper[4807]: I1014 13:35:29.216468 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-fe87-account-create-6crd5" event={"ID":"3a38fc97-3de1-43a0-af06-748de7eea473","Type":"ContainerStarted","Data":"2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e"} Oct 14 13:35:29.221969 master-0 kubenswrapper[4807]: I1014 13:35:29.220337 4807 generic.go:334] "Generic (PLEG): container finished" podID="f774784d-e9d4-4293-b9f7-3ce1260f1d19" containerID="075a59d57c58142d65ec1f85ecea3e8e9cf3c87de2c09b43c4a605f75a29b725" exitCode=0 Oct 14 13:35:29.221969 master-0 kubenswrapper[4807]: I1014 13:35:29.220403 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-7e6f-account-create-ln8x7" event={"ID":"f774784d-e9d4-4293-b9f7-3ce1260f1d19","Type":"ContainerDied","Data":"075a59d57c58142d65ec1f85ecea3e8e9cf3c87de2c09b43c4a605f75a29b725"} Oct 14 13:35:29.264705 master-0 kubenswrapper[4807]: I1014 13:35:29.264616 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-db-create-lgjbp"] Oct 14 13:35:29.266180 master-0 kubenswrapper[4807]: I1014 13:35:29.265921 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:29.288284 master-0 kubenswrapper[4807]: I1014 13:35:29.288205 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-lgjbp"] Oct 14 13:35:29.346513 master-0 kubenswrapper[4807]: I1014 13:35:29.346421 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/heat-db-create-kg5d4"] Oct 14 13:35:29.347779 master-0 kubenswrapper[4807]: I1014 13:35:29.347743 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:29.359907 master-0 kubenswrapper[4807]: I1014 13:35:29.358398 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bpdx\" (UniqueName: \"kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx\") pod \"cinder-db-create-lgjbp\" (UID: \"b6d368a6-4114-443f-a3d0-0cb58c2fc860\") " pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:29.380588 master-0 kubenswrapper[4807]: I1014 13:35:29.379831 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-db-create-kg5d4"] Oct 14 13:35:29.460433 master-0 kubenswrapper[4807]: I1014 13:35:29.460286 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5d6tp\" (UniqueName: \"kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp\") pod \"heat-db-create-kg5d4\" (UID: \"22319933-9e06-424f-89ad-2c1c9cf12e21\") " pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:29.460433 master-0 kubenswrapper[4807]: I1014 13:35:29.460386 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2bpdx\" (UniqueName: \"kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx\") pod \"cinder-db-create-lgjbp\" (UID: \"b6d368a6-4114-443f-a3d0-0cb58c2fc860\") " pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:29.483659 master-0 kubenswrapper[4807]: I1014 13:35:29.483612 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bpdx\" (UniqueName: \"kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx\") pod \"cinder-db-create-lgjbp\" (UID: \"b6d368a6-4114-443f-a3d0-0cb58c2fc860\") " pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:29.562171 master-0 kubenswrapper[4807]: I1014 13:35:29.562083 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5d6tp\" (UniqueName: \"kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp\") pod \"heat-db-create-kg5d4\" (UID: \"22319933-9e06-424f-89ad-2c1c9cf12e21\") " pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:29.591656 master-0 kubenswrapper[4807]: I1014 13:35:29.589777 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5d6tp\" (UniqueName: \"kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp\") pod \"heat-db-create-kg5d4\" (UID: \"22319933-9e06-424f-89ad-2c1c9cf12e21\") " pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:29.594950 master-0 kubenswrapper[4807]: I1014 13:35:29.594885 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:29.676500 master-0 kubenswrapper[4807]: I1014 13:35:29.676090 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:29.771796 master-0 kubenswrapper[4807]: I1014 13:35:29.768065 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/barbican-db-create-6mbbn"] Oct 14 13:35:29.786840 master-0 kubenswrapper[4807]: W1014 13:35:29.786760 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4fa2a4c1_49a4_4681_ac8a_ed89d64c53d9.slice/crio-64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683 WatchSource:0}: Error finding container 64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683: Status 404 returned error can't find the container with id 64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683 Oct 14 13:35:30.044140 master-0 kubenswrapper[4807]: I1014 13:35:30.038647 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-db-create-lgjbp"] Oct 14 13:35:30.209131 master-0 kubenswrapper[4807]: I1014 13:35:30.209066 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-db-create-kg5d4"] Oct 14 13:35:30.239569 master-0 kubenswrapper[4807]: I1014 13:35:30.239393 4807 generic.go:334] "Generic (PLEG): container finished" podID="4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" containerID="1f2a94ad409ded9f97935644a655870ee0fa7b975225ddbad6fd0f18dc570c15" exitCode=0 Oct 14 13:35:30.239569 master-0 kubenswrapper[4807]: I1014 13:35:30.239519 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-db-create-6mbbn" event={"ID":"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9","Type":"ContainerDied","Data":"1f2a94ad409ded9f97935644a655870ee0fa7b975225ddbad6fd0f18dc570c15"} Oct 14 13:35:30.239569 master-0 kubenswrapper[4807]: I1014 13:35:30.239558 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-db-create-6mbbn" event={"ID":"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9","Type":"ContainerStarted","Data":"64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683"} Oct 14 13:35:30.242137 master-0 kubenswrapper[4807]: I1014 13:35:30.242030 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgjbp" event={"ID":"b6d368a6-4114-443f-a3d0-0cb58c2fc860","Type":"ContainerStarted","Data":"1b50f9b0391cdc1452e3db422023cef5dd9bec8a6616eb9de01cf7078647ee0c"} Oct 14 13:35:30.248031 master-0 kubenswrapper[4807]: W1014 13:35:30.247977 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22319933_9e06_424f_89ad_2c1c9cf12e21.slice/crio-8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736 WatchSource:0}: Error finding container 8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736: Status 404 returned error can't find the container with id 8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736 Oct 14 13:35:30.281957 master-0 kubenswrapper[4807]: I1014 13:35:30.281907 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:30.287207 master-0 kubenswrapper[4807]: I1014 13:35:30.287162 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-swift\" (UniqueName: \"kubernetes.io/projected/68fbeea1-cbf0-44b7-a159-08369455b5e6-etc-swift\") pod \"swift-storage-0\" (UID: \"68fbeea1-cbf0-44b7-a159-08369455b5e6\") " pod="openstack/swift-storage-0" Oct 14 13:35:30.469422 master-0 kubenswrapper[4807]: I1014 13:35:30.469171 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/swift-storage-0" Oct 14 13:35:30.799250 master-0 kubenswrapper[4807]: I1014 13:35:30.798875 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:30.814336 master-0 kubenswrapper[4807]: I1014 13:35:30.814266 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:30.904900 master-0 kubenswrapper[4807]: I1014 13:35:30.904829 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqvxn\" (UniqueName: \"kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn\") pod \"3a38fc97-3de1-43a0-af06-748de7eea473\" (UID: \"3a38fc97-3de1-43a0-af06-748de7eea473\") " Oct 14 13:35:30.907840 master-0 kubenswrapper[4807]: I1014 13:35:30.907779 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn" (OuterVolumeSpecName: "kube-api-access-zqvxn") pod "3a38fc97-3de1-43a0-af06-748de7eea473" (UID: "3a38fc97-3de1-43a0-af06-748de7eea473"). InnerVolumeSpecName "kube-api-access-zqvxn". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:31.010490 master-0 kubenswrapper[4807]: I1014 13:35:31.010336 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-psphg\" (UniqueName: \"kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg\") pod \"f774784d-e9d4-4293-b9f7-3ce1260f1d19\" (UID: \"f774784d-e9d4-4293-b9f7-3ce1260f1d19\") " Oct 14 13:35:31.011350 master-0 kubenswrapper[4807]: I1014 13:35:31.011316 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-zqvxn\" (UniqueName: \"kubernetes.io/projected/3a38fc97-3de1-43a0-af06-748de7eea473-kube-api-access-zqvxn\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:31.015763 master-0 kubenswrapper[4807]: I1014 13:35:31.015507 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/swift-storage-0"] Oct 14 13:35:31.017826 master-0 kubenswrapper[4807]: I1014 13:35:31.017726 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg" (OuterVolumeSpecName: "kube-api-access-psphg") pod "f774784d-e9d4-4293-b9f7-3ce1260f1d19" (UID: "f774784d-e9d4-4293-b9f7-3ce1260f1d19"). InnerVolumeSpecName "kube-api-access-psphg". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:31.022662 master-0 kubenswrapper[4807]: W1014 13:35:31.022606 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68fbeea1_cbf0_44b7_a159_08369455b5e6.slice/crio-d48701788ef2dea7e49f81b5e4681af97e459b69d13b986ee2fe42370a0e70f1 WatchSource:0}: Error finding container d48701788ef2dea7e49f81b5e4681af97e459b69d13b986ee2fe42370a0e70f1: Status 404 returned error can't find the container with id d48701788ef2dea7e49f81b5e4681af97e459b69d13b986ee2fe42370a0e70f1 Oct 14 13:35:31.113737 master-0 kubenswrapper[4807]: I1014 13:35:31.113642 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-psphg\" (UniqueName: \"kubernetes.io/projected/f774784d-e9d4-4293-b9f7-3ce1260f1d19-kube-api-access-psphg\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:31.256046 master-0 kubenswrapper[4807]: I1014 13:35:31.255962 4807 generic.go:334] "Generic (PLEG): container finished" podID="b6d368a6-4114-443f-a3d0-0cb58c2fc860" containerID="b72be291260aecd5713d1a0256d2f6e2701cb5aa756f367c436736dc4ef35fb6" exitCode=0 Oct 14 13:35:31.256046 master-0 kubenswrapper[4807]: I1014 13:35:31.256057 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgjbp" event={"ID":"b6d368a6-4114-443f-a3d0-0cb58c2fc860","Type":"ContainerDied","Data":"b72be291260aecd5713d1a0256d2f6e2701cb5aa756f367c436736dc4ef35fb6"} Oct 14 13:35:31.259391 master-0 kubenswrapper[4807]: I1014 13:35:31.259348 4807 generic.go:334] "Generic (PLEG): container finished" podID="22319933-9e06-424f-89ad-2c1c9cf12e21" containerID="6d5b02055b7eb1642db99602c894b3a4a55fdc4b27b78bb4f4949cfe75570f11" exitCode=0 Oct 14 13:35:31.259628 master-0 kubenswrapper[4807]: I1014 13:35:31.259476 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-db-create-kg5d4" event={"ID":"22319933-9e06-424f-89ad-2c1c9cf12e21","Type":"ContainerDied","Data":"6d5b02055b7eb1642db99602c894b3a4a55fdc4b27b78bb4f4949cfe75570f11"} Oct 14 13:35:31.259628 master-0 kubenswrapper[4807]: I1014 13:35:31.259570 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-db-create-kg5d4" event={"ID":"22319933-9e06-424f-89ad-2c1c9cf12e21","Type":"ContainerStarted","Data":"8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736"} Oct 14 13:35:31.262568 master-0 kubenswrapper[4807]: I1014 13:35:31.262470 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-7e6f-account-create-ln8x7" Oct 14 13:35:31.262568 master-0 kubenswrapper[4807]: I1014 13:35:31.262493 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-7e6f-account-create-ln8x7" event={"ID":"f774784d-e9d4-4293-b9f7-3ce1260f1d19","Type":"ContainerDied","Data":"cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd"} Oct 14 13:35:31.262804 master-0 kubenswrapper[4807]: I1014 13:35:31.262539 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cdb4f5d4806d3b9ac51ed03fbafdf750b9764e12a38e12cc0c57b61d84cecdcd" Oct 14 13:35:31.264962 master-0 kubenswrapper[4807]: I1014 13:35:31.264868 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"d48701788ef2dea7e49f81b5e4681af97e459b69d13b986ee2fe42370a0e70f1"} Oct 14 13:35:31.267556 master-0 kubenswrapper[4807]: I1014 13:35:31.267501 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-fe87-account-create-6crd5" event={"ID":"3a38fc97-3de1-43a0-af06-748de7eea473","Type":"ContainerDied","Data":"2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e"} Oct 14 13:35:31.267556 master-0 kubenswrapper[4807]: I1014 13:35:31.267536 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c433b176c943b45da124902084d33f29229276cebf660bd96e60ffd92196f6e" Oct 14 13:35:31.267840 master-0 kubenswrapper[4807]: I1014 13:35:31.267623 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/placement-fe87-account-create-6crd5" Oct 14 13:35:31.638061 master-0 kubenswrapper[4807]: I1014 13:35:31.637992 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:31.825147 master-0 kubenswrapper[4807]: I1014 13:35:31.825076 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cl66\" (UniqueName: \"kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66\") pod \"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9\" (UID: \"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9\") " Oct 14 13:35:31.829253 master-0 kubenswrapper[4807]: I1014 13:35:31.829163 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66" (OuterVolumeSpecName: "kube-api-access-7cl66") pod "4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" (UID: "4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9"). InnerVolumeSpecName "kube-api-access-7cl66". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:31.927049 master-0 kubenswrapper[4807]: I1014 13:35:31.926939 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7cl66\" (UniqueName: \"kubernetes.io/projected/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9-kube-api-access-7cl66\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:32.279841 master-0 kubenswrapper[4807]: I1014 13:35:32.279679 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-db-create-6mbbn" event={"ID":"4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9","Type":"ContainerDied","Data":"64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683"} Oct 14 13:35:32.279841 master-0 kubenswrapper[4807]: I1014 13:35:32.279761 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64a083d77c71af9af3424daa6c4f628bd474c24edf3d8a9d16b8878723791683" Oct 14 13:35:32.280166 master-0 kubenswrapper[4807]: I1014 13:35:32.279835 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-db-create-6mbbn" Oct 14 13:35:32.775035 master-0 kubenswrapper[4807]: I1014 13:35:32.774974 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:32.841734 master-0 kubenswrapper[4807]: I1014 13:35:32.841665 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:32.948788 master-0 kubenswrapper[4807]: I1014 13:35:32.947908 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5d6tp\" (UniqueName: \"kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp\") pod \"22319933-9e06-424f-89ad-2c1c9cf12e21\" (UID: \"22319933-9e06-424f-89ad-2c1c9cf12e21\") " Oct 14 13:35:32.948788 master-0 kubenswrapper[4807]: I1014 13:35:32.948006 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2bpdx\" (UniqueName: \"kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx\") pod \"b6d368a6-4114-443f-a3d0-0cb58c2fc860\" (UID: \"b6d368a6-4114-443f-a3d0-0cb58c2fc860\") " Oct 14 13:35:32.958074 master-0 kubenswrapper[4807]: I1014 13:35:32.957985 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx" (OuterVolumeSpecName: "kube-api-access-2bpdx") pod "b6d368a6-4114-443f-a3d0-0cb58c2fc860" (UID: "b6d368a6-4114-443f-a3d0-0cb58c2fc860"). InnerVolumeSpecName "kube-api-access-2bpdx". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:32.960551 master-0 kubenswrapper[4807]: I1014 13:35:32.960436 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp" (OuterVolumeSpecName: "kube-api-access-5d6tp") pod "22319933-9e06-424f-89ad-2c1c9cf12e21" (UID: "22319933-9e06-424f-89ad-2c1c9cf12e21"). InnerVolumeSpecName "kube-api-access-5d6tp". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:33.050706 master-0 kubenswrapper[4807]: I1014 13:35:33.050618 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5d6tp\" (UniqueName: \"kubernetes.io/projected/22319933-9e06-424f-89ad-2c1c9cf12e21-kube-api-access-5d6tp\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:33.050706 master-0 kubenswrapper[4807]: I1014 13:35:33.050660 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2bpdx\" (UniqueName: \"kubernetes.io/projected/b6d368a6-4114-443f-a3d0-0cb58c2fc860-kube-api-access-2bpdx\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:33.296847 master-0 kubenswrapper[4807]: I1014 13:35:33.296676 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-db-create-lgjbp" event={"ID":"b6d368a6-4114-443f-a3d0-0cb58c2fc860","Type":"ContainerDied","Data":"1b50f9b0391cdc1452e3db422023cef5dd9bec8a6616eb9de01cf7078647ee0c"} Oct 14 13:35:33.296847 master-0 kubenswrapper[4807]: I1014 13:35:33.296757 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1b50f9b0391cdc1452e3db422023cef5dd9bec8a6616eb9de01cf7078647ee0c" Oct 14 13:35:33.296847 master-0 kubenswrapper[4807]: I1014 13:35:33.296718 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-db-create-lgjbp" Oct 14 13:35:33.299168 master-0 kubenswrapper[4807]: I1014 13:35:33.299123 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-db-create-kg5d4" event={"ID":"22319933-9e06-424f-89ad-2c1c9cf12e21","Type":"ContainerDied","Data":"8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736"} Oct 14 13:35:33.299302 master-0 kubenswrapper[4807]: I1014 13:35:33.299286 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8eef75341565cca8824d7683c279fb23a05986ec7450540aa728808547e79736" Oct 14 13:35:33.299388 master-0 kubenswrapper[4807]: I1014 13:35:33.299308 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-db-create-kg5d4" Oct 14 13:35:35.551107 master-0 kubenswrapper[4807]: I1014 13:35:35.551015 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-d6bb-account-create-cmbxg"] Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: E1014 13:35:35.551335 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3a38fc97-3de1-43a0-af06-748de7eea473" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551355 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a38fc97-3de1-43a0-af06-748de7eea473" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: E1014 13:35:35.551370 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f774784d-e9d4-4293-b9f7-3ce1260f1d19" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551376 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="f774784d-e9d4-4293-b9f7-3ce1260f1d19" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: E1014 13:35:35.551395 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="22319933-9e06-424f-89ad-2c1c9cf12e21" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551403 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="22319933-9e06-424f-89ad-2c1c9cf12e21" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: E1014 13:35:35.551422 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="b6d368a6-4114-443f-a3d0-0cb58c2fc860" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551429 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6d368a6-4114-443f-a3d0-0cb58c2fc860" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: E1014 13:35:35.551437 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551447 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551587 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551600 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="f774784d-e9d4-4293-b9f7-3ce1260f1d19" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551612 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="b6d368a6-4114-443f-a3d0-0cb58c2fc860" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551618 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="22319933-9e06-424f-89ad-2c1c9cf12e21" containerName="mariadb-database-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.551626 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="3a38fc97-3de1-43a0-af06-748de7eea473" containerName="mariadb-account-create" Oct 14 13:35:35.553022 master-0 kubenswrapper[4807]: I1014 13:35:35.552287 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:35.555314 master-0 kubenswrapper[4807]: I1014 13:35:35.555282 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-db-secret" Oct 14 13:35:35.568077 master-0 kubenswrapper[4807]: I1014 13:35:35.568028 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-d6bb-account-create-cmbxg"] Oct 14 13:35:35.604093 master-0 kubenswrapper[4807]: I1014 13:35:35.603917 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c5nl\" (UniqueName: \"kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl\") pod \"glance-d6bb-account-create-cmbxg\" (UID: \"9e9b1f09-655a-4d72-9f24-7067135e6de0\") " pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:35.705798 master-0 kubenswrapper[4807]: I1014 13:35:35.705716 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-9c5nl\" (UniqueName: \"kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl\") pod \"glance-d6bb-account-create-cmbxg\" (UID: \"9e9b1f09-655a-4d72-9f24-7067135e6de0\") " pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:36.046417 master-0 kubenswrapper[4807]: I1014 13:35:36.046341 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c5nl\" (UniqueName: \"kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl\") pod \"glance-d6bb-account-create-cmbxg\" (UID: \"9e9b1f09-655a-4d72-9f24-7067135e6de0\") " pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:36.176869 master-0 kubenswrapper[4807]: I1014 13:35:36.176787 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:37.086322 master-0 kubenswrapper[4807]: I1014 13:35:37.086048 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-d6bb-account-create-cmbxg"] Oct 14 13:35:38.355670 master-0 kubenswrapper[4807]: I1014 13:35:38.355498 4807 generic.go:334] "Generic (PLEG): container finished" podID="e2cb06a7-0193-46d1-a0b1-d593198327b9" containerID="70c96ee2ab9e1a087a3febd6168fb9e9832c118b220e956384a58249a3009a98" exitCode=0 Oct 14 13:35:38.355670 master-0 kubenswrapper[4807]: I1014 13:35:38.355640 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerDied","Data":"70c96ee2ab9e1a087a3febd6168fb9e9832c118b220e956384a58249a3009a98"} Oct 14 13:35:38.358902 master-0 kubenswrapper[4807]: I1014 13:35:38.358842 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-d6bb-account-create-cmbxg" event={"ID":"9e9b1f09-655a-4d72-9f24-7067135e6de0","Type":"ContainerStarted","Data":"32a1d058684cbfa70ca3da81e8623ab19dcf201a5993b8e1fa08cee4c730c074"} Oct 14 13:35:38.846232 master-0 kubenswrapper[4807]: I1014 13:35:38.845889 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/barbican-6fa4-account-create-gtm96"] Oct 14 13:35:38.853316 master-0 kubenswrapper[4807]: I1014 13:35:38.849398 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:38.855355 master-0 kubenswrapper[4807]: I1014 13:35:38.855288 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"barbican-db-secret" Oct 14 13:35:38.873956 master-0 kubenswrapper[4807]: I1014 13:35:38.873846 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8w96\" (UniqueName: \"kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96\") pod \"barbican-6fa4-account-create-gtm96\" (UID: \"1122c4c0-d1a1-4b65-8e30-09a7ab543979\") " pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:38.882136 master-0 kubenswrapper[4807]: I1014 13:35:38.882073 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/barbican-6fa4-account-create-gtm96"] Oct 14 13:35:38.977725 master-0 kubenswrapper[4807]: I1014 13:35:38.977655 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-d8w96\" (UniqueName: \"kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96\") pod \"barbican-6fa4-account-create-gtm96\" (UID: \"1122c4c0-d1a1-4b65-8e30-09a7ab543979\") " pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:39.002667 master-0 kubenswrapper[4807]: I1014 13:35:39.002602 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8w96\" (UniqueName: \"kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96\") pod \"barbican-6fa4-account-create-gtm96\" (UID: \"1122c4c0-d1a1-4b65-8e30-09a7ab543979\") " pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:39.066516 master-0 kubenswrapper[4807]: I1014 13:35:39.066217 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/heat-9d01-account-create-q4lw2"] Oct 14 13:35:39.069106 master-0 kubenswrapper[4807]: I1014 13:35:39.069054 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:39.076362 master-0 kubenswrapper[4807]: I1014 13:35:39.076286 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-9d01-account-create-q4lw2"] Oct 14 13:35:39.078787 master-0 kubenswrapper[4807]: I1014 13:35:39.078741 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"heat-db-secret" Oct 14 13:35:39.185532 master-0 kubenswrapper[4807]: I1014 13:35:39.185430 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjtdf\" (UniqueName: \"kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf\") pod \"heat-9d01-account-create-q4lw2\" (UID: \"13e302d5-d89f-4a34-a041-eee10e251d24\") " pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:39.208156 master-0 kubenswrapper[4807]: I1014 13:35:39.208098 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:39.288852 master-0 kubenswrapper[4807]: I1014 13:35:39.288078 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-wjtdf\" (UniqueName: \"kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf\") pod \"heat-9d01-account-create-q4lw2\" (UID: \"13e302d5-d89f-4a34-a041-eee10e251d24\") " pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:39.291395 master-0 kubenswrapper[4807]: I1014 13:35:39.290954 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-e815-account-create-k9rrg"] Oct 14 13:35:39.301290 master-0 kubenswrapper[4807]: I1014 13:35:39.292219 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:39.312680 master-0 kubenswrapper[4807]: I1014 13:35:39.309578 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-db-secret" Oct 14 13:35:39.336441 master-0 kubenswrapper[4807]: I1014 13:35:39.335523 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-e815-account-create-k9rrg"] Oct 14 13:35:39.409311 master-0 kubenswrapper[4807]: I1014 13:35:39.409251 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5hl4\" (UniqueName: \"kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4\") pod \"neutron-e815-account-create-k9rrg\" (UID: \"fe7bfab3-b4c5-4f22-b86c-d237c3edf145\") " pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:39.440310 master-0 kubenswrapper[4807]: I1014 13:35:39.440266 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjtdf\" (UniqueName: \"kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf\") pod \"heat-9d01-account-create-q4lw2\" (UID: \"13e302d5-d89f-4a34-a041-eee10e251d24\") " pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:39.516592 master-0 kubenswrapper[4807]: I1014 13:35:39.515963 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-x5hl4\" (UniqueName: \"kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4\") pod \"neutron-e815-account-create-k9rrg\" (UID: \"fe7bfab3-b4c5-4f22-b86c-d237c3edf145\") " pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:39.574527 master-0 kubenswrapper[4807]: I1014 13:35:39.574426 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5hl4\" (UniqueName: \"kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4\") pod \"neutron-e815-account-create-k9rrg\" (UID: \"fe7bfab3-b4c5-4f22-b86c-d237c3edf145\") " pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:39.587971 master-0 kubenswrapper[4807]: I1014 13:35:39.587881 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"091aa94169bb2d543714ead0839851cf19733d327f9491c65bcb9ec38f2400e2"} Oct 14 13:35:39.587971 master-0 kubenswrapper[4807]: I1014 13:35:39.587956 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"27dc37885d46cd11f531c8f2eb1b7a73293d801d2929bf5f43497fa7e863d615"} Oct 14 13:35:39.587971 master-0 kubenswrapper[4807]: I1014 13:35:39.587966 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"e1d1d36c76bf9e75e92d7543405fbbcb9ebb75ceeed23f487d182d44ba90df7b"} Oct 14 13:35:39.590375 master-0 kubenswrapper[4807]: I1014 13:35:39.590332 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerStarted","Data":"eccba7b461c5ad1aa2fd96706edaf02f92f4012e7bcd0a5f263758812fa1f2c2"} Oct 14 13:35:39.591639 master-0 kubenswrapper[4807]: I1014 13:35:39.591512 4807 generic.go:334] "Generic (PLEG): container finished" podID="9e9b1f09-655a-4d72-9f24-7067135e6de0" containerID="f1760f5110c645bd3718bfe24d4e94d056a876c2a8dba56dc1dabe3f689e2a81" exitCode=0 Oct 14 13:35:39.591639 master-0 kubenswrapper[4807]: I1014 13:35:39.591546 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-d6bb-account-create-cmbxg" event={"ID":"9e9b1f09-655a-4d72-9f24-7067135e6de0","Type":"ContainerDied","Data":"f1760f5110c645bd3718bfe24d4e94d056a876c2a8dba56dc1dabe3f689e2a81"} Oct 14 13:35:39.684189 master-0 kubenswrapper[4807]: I1014 13:35:39.684131 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:39.763366 master-0 kubenswrapper[4807]: I1014 13:35:39.763299 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/barbican-6fa4-account-create-gtm96"] Oct 14 13:35:39.852606 master-0 kubenswrapper[4807]: I1014 13:35:39.852549 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:40.133979 master-0 kubenswrapper[4807]: I1014 13:35:40.133929 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-9d01-account-create-q4lw2"] Oct 14 13:35:40.363657 master-0 kubenswrapper[4807]: I1014 13:35:40.363596 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-e815-account-create-k9rrg"] Oct 14 13:35:40.370774 master-0 kubenswrapper[4807]: W1014 13:35:40.370714 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe7bfab3_b4c5_4f22_b86c_d237c3edf145.slice/crio-505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d WatchSource:0}: Error finding container 505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d: Status 404 returned error can't find the container with id 505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d Oct 14 13:35:40.602505 master-0 kubenswrapper[4807]: I1014 13:35:40.602421 4807 generic.go:334] "Generic (PLEG): container finished" podID="13e302d5-d89f-4a34-a041-eee10e251d24" containerID="5dc2d7111f48307491cb740d79dac5ab26b772ebb8129d417a2b316d94bc40a4" exitCode=0 Oct 14 13:35:40.603126 master-0 kubenswrapper[4807]: I1014 13:35:40.602508 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-9d01-account-create-q4lw2" event={"ID":"13e302d5-d89f-4a34-a041-eee10e251d24","Type":"ContainerDied","Data":"5dc2d7111f48307491cb740d79dac5ab26b772ebb8129d417a2b316d94bc40a4"} Oct 14 13:35:40.603126 master-0 kubenswrapper[4807]: I1014 13:35:40.602570 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-9d01-account-create-q4lw2" event={"ID":"13e302d5-d89f-4a34-a041-eee10e251d24","Type":"ContainerStarted","Data":"068f4f313326501dea81c5a192a378adf99a40e985cfdf51ae8b814672f543bb"} Oct 14 13:35:40.604087 master-0 kubenswrapper[4807]: I1014 13:35:40.604047 4807 generic.go:334] "Generic (PLEG): container finished" podID="1122c4c0-d1a1-4b65-8e30-09a7ab543979" containerID="d16d22aed023d43936da07c839658f96c83d935663bd17377bbdbe505ce03033" exitCode=0 Oct 14 13:35:40.604189 master-0 kubenswrapper[4807]: I1014 13:35:40.604151 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-6fa4-account-create-gtm96" event={"ID":"1122c4c0-d1a1-4b65-8e30-09a7ab543979","Type":"ContainerDied","Data":"d16d22aed023d43936da07c839658f96c83d935663bd17377bbdbe505ce03033"} Oct 14 13:35:40.604237 master-0 kubenswrapper[4807]: I1014 13:35:40.604200 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-6fa4-account-create-gtm96" event={"ID":"1122c4c0-d1a1-4b65-8e30-09a7ab543979","Type":"ContainerStarted","Data":"dbb10459be151c51ecb930aa470e717a3cfd55ff519b9ec0e58dc256ccaf3104"} Oct 14 13:35:40.607578 master-0 kubenswrapper[4807]: I1014 13:35:40.607452 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"627fac87f1b37db7fedcfa6ab76df7ae181957237de52c5754a43eb53bb11a6e"} Oct 14 13:35:40.609031 master-0 kubenswrapper[4807]: I1014 13:35:40.608990 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-e815-account-create-k9rrg" event={"ID":"fe7bfab3-b4c5-4f22-b86c-d237c3edf145","Type":"ContainerStarted","Data":"803901bffef2b227e43d7d3535cc175414c3e83fd726c4d70b58c0412a2cc026"} Oct 14 13:35:40.609086 master-0 kubenswrapper[4807]: I1014 13:35:40.609033 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-e815-account-create-k9rrg" event={"ID":"fe7bfab3-b4c5-4f22-b86c-d237c3edf145","Type":"ContainerStarted","Data":"505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d"} Oct 14 13:35:41.622726 master-0 kubenswrapper[4807]: I1014 13:35:41.622651 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-d6bb-account-create-cmbxg" event={"ID":"9e9b1f09-655a-4d72-9f24-7067135e6de0","Type":"ContainerDied","Data":"32a1d058684cbfa70ca3da81e8623ab19dcf201a5993b8e1fa08cee4c730c074"} Oct 14 13:35:41.623314 master-0 kubenswrapper[4807]: I1014 13:35:41.622732 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="32a1d058684cbfa70ca3da81e8623ab19dcf201a5993b8e1fa08cee4c730c074" Oct 14 13:35:41.626955 master-0 kubenswrapper[4807]: I1014 13:35:41.626873 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerStarted","Data":"e2c31f7285a719f5d3bde9428fa8edbe78c7e0f80f4bdde59e843f255ad23821"} Oct 14 13:35:41.629290 master-0 kubenswrapper[4807]: I1014 13:35:41.629235 4807 generic.go:334] "Generic (PLEG): container finished" podID="fe7bfab3-b4c5-4f22-b86c-d237c3edf145" containerID="803901bffef2b227e43d7d3535cc175414c3e83fd726c4d70b58c0412a2cc026" exitCode=0 Oct 14 13:35:41.629423 master-0 kubenswrapper[4807]: I1014 13:35:41.629328 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-e815-account-create-k9rrg" event={"ID":"fe7bfab3-b4c5-4f22-b86c-d237c3edf145","Type":"ContainerDied","Data":"803901bffef2b227e43d7d3535cc175414c3e83fd726c4d70b58c0412a2cc026"} Oct 14 13:35:41.636002 master-0 kubenswrapper[4807]: I1014 13:35:41.635927 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:41.660340 master-0 kubenswrapper[4807]: I1014 13:35:41.660303 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9c5nl\" (UniqueName: \"kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl\") pod \"9e9b1f09-655a-4d72-9f24-7067135e6de0\" (UID: \"9e9b1f09-655a-4d72-9f24-7067135e6de0\") " Oct 14 13:35:41.663715 master-0 kubenswrapper[4807]: I1014 13:35:41.663678 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl" (OuterVolumeSpecName: "kube-api-access-9c5nl") pod "9e9b1f09-655a-4d72-9f24-7067135e6de0" (UID: "9e9b1f09-655a-4d72-9f24-7067135e6de0"). InnerVolumeSpecName "kube-api-access-9c5nl". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:41.762211 master-0 kubenswrapper[4807]: I1014 13:35:41.762125 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-9c5nl\" (UniqueName: \"kubernetes.io/projected/9e9b1f09-655a-4d72-9f24-7067135e6de0-kube-api-access-9c5nl\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:42.249743 master-0 kubenswrapper[4807]: I1014 13:35:42.249699 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:42.257926 master-0 kubenswrapper[4807]: I1014 13:35:42.257812 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:42.389780 master-0 kubenswrapper[4807]: I1014 13:35:42.389728 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8w96\" (UniqueName: \"kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96\") pod \"1122c4c0-d1a1-4b65-8e30-09a7ab543979\" (UID: \"1122c4c0-d1a1-4b65-8e30-09a7ab543979\") " Oct 14 13:35:42.389951 master-0 kubenswrapper[4807]: I1014 13:35:42.389914 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wjtdf\" (UniqueName: \"kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf\") pod \"13e302d5-d89f-4a34-a041-eee10e251d24\" (UID: \"13e302d5-d89f-4a34-a041-eee10e251d24\") " Oct 14 13:35:42.394382 master-0 kubenswrapper[4807]: I1014 13:35:42.394341 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf" (OuterVolumeSpecName: "kube-api-access-wjtdf") pod "13e302d5-d89f-4a34-a041-eee10e251d24" (UID: "13e302d5-d89f-4a34-a041-eee10e251d24"). InnerVolumeSpecName "kube-api-access-wjtdf". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:42.397926 master-0 kubenswrapper[4807]: I1014 13:35:42.397855 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96" (OuterVolumeSpecName: "kube-api-access-d8w96") pod "1122c4c0-d1a1-4b65-8e30-09a7ab543979" (UID: "1122c4c0-d1a1-4b65-8e30-09a7ab543979"). InnerVolumeSpecName "kube-api-access-d8w96". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:42.493883 master-0 kubenswrapper[4807]: I1014 13:35:42.493825 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-d8w96\" (UniqueName: \"kubernetes.io/projected/1122c4c0-d1a1-4b65-8e30-09a7ab543979-kube-api-access-d8w96\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:42.493883 master-0 kubenswrapper[4807]: I1014 13:35:42.493881 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-wjtdf\" (UniqueName: \"kubernetes.io/projected/13e302d5-d89f-4a34-a041-eee10e251d24-kube-api-access-wjtdf\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:42.648657 master-0 kubenswrapper[4807]: I1014 13:35:42.648410 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/barbican-6fa4-account-create-gtm96" event={"ID":"1122c4c0-d1a1-4b65-8e30-09a7ab543979","Type":"ContainerDied","Data":"dbb10459be151c51ecb930aa470e717a3cfd55ff519b9ec0e58dc256ccaf3104"} Oct 14 13:35:42.648657 master-0 kubenswrapper[4807]: I1014 13:35:42.648533 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dbb10459be151c51ecb930aa470e717a3cfd55ff519b9ec0e58dc256ccaf3104" Oct 14 13:35:42.648657 master-0 kubenswrapper[4807]: I1014 13:35:42.648624 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/barbican-6fa4-account-create-gtm96" Oct 14 13:35:42.653340 master-0 kubenswrapper[4807]: I1014 13:35:42.653298 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"c007692b31968bf383481d36b57971959799bb8ecd78618a72bc5fe0c0c6f942"} Oct 14 13:35:42.653340 master-0 kubenswrapper[4807]: I1014 13:35:42.653330 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"b189ca39ec588c89824a6ad8571481e99dd6c4ae807761c8ea52d23f1d782071"} Oct 14 13:35:42.653340 master-0 kubenswrapper[4807]: I1014 13:35:42.653343 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"3f84fe2ec2cd9610cc5ec31cedaa41c61b53384531d7b17176508e0c8f4d6454"} Oct 14 13:35:42.657421 master-0 kubenswrapper[4807]: I1014 13:35:42.657366 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/prometheus-metric-storage-0" event={"ID":"e2cb06a7-0193-46d1-a0b1-d593198327b9","Type":"ContainerStarted","Data":"e78bf5f61e1d67fe74a1991700b63aa9c62838e68db04e4339d9e245ff74eb64"} Oct 14 13:35:42.659532 master-0 kubenswrapper[4807]: I1014 13:35:42.659446 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-9d01-account-create-q4lw2" event={"ID":"13e302d5-d89f-4a34-a041-eee10e251d24","Type":"ContainerDied","Data":"068f4f313326501dea81c5a192a378adf99a40e985cfdf51ae8b814672f543bb"} Oct 14 13:35:42.659532 master-0 kubenswrapper[4807]: I1014 13:35:42.659490 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-d6bb-account-create-cmbxg" Oct 14 13:35:42.659626 master-0 kubenswrapper[4807]: I1014 13:35:42.659551 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="068f4f313326501dea81c5a192a378adf99a40e985cfdf51ae8b814672f543bb" Oct 14 13:35:42.659626 master-0 kubenswrapper[4807]: I1014 13:35:42.659513 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-9d01-account-create-q4lw2" Oct 14 13:35:42.724935 master-0 kubenswrapper[4807]: I1014 13:35:42.724721 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/prometheus-metric-storage-0" podStartSLOduration=18.724691512 podStartE2EDuration="18.724691512s" podCreationTimestamp="2025-10-14 13:35:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:35:42.724667661 +0000 UTC m=+937.405969505" watchObservedRunningTime="2025-10-14 13:35:42.724691512 +0000 UTC m=+937.405993346" Oct 14 13:35:43.033557 master-0 kubenswrapper[4807]: I1014 13:35:43.033499 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:43.104763 master-0 kubenswrapper[4807]: I1014 13:35:43.104682 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5hl4\" (UniqueName: \"kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4\") pod \"fe7bfab3-b4c5-4f22-b86c-d237c3edf145\" (UID: \"fe7bfab3-b4c5-4f22-b86c-d237c3edf145\") " Oct 14 13:35:43.110357 master-0 kubenswrapper[4807]: I1014 13:35:43.110248 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4" (OuterVolumeSpecName: "kube-api-access-x5hl4") pod "fe7bfab3-b4c5-4f22-b86c-d237c3edf145" (UID: "fe7bfab3-b4c5-4f22-b86c-d237c3edf145"). InnerVolumeSpecName "kube-api-access-x5hl4". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:43.207312 master-0 kubenswrapper[4807]: I1014 13:35:43.207218 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-x5hl4\" (UniqueName: \"kubernetes.io/projected/fe7bfab3-b4c5-4f22-b86c-d237c3edf145-kube-api-access-x5hl4\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:43.670321 master-0 kubenswrapper[4807]: I1014 13:35:43.670222 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"e149f0732a2c3ba3ff607b779de6ad574096f4a9af47b783da10e975d5eb889a"} Oct 14 13:35:43.672704 master-0 kubenswrapper[4807]: I1014 13:35:43.672651 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-e815-account-create-k9rrg" event={"ID":"fe7bfab3-b4c5-4f22-b86c-d237c3edf145","Type":"ContainerDied","Data":"505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d"} Oct 14 13:35:43.672807 master-0 kubenswrapper[4807]: I1014 13:35:43.672714 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="505b6d5d49409a3eccbaf4dadc07558f008f1192bff3b7bd1ee74f10be88405d" Oct 14 13:35:43.672807 master-0 kubenswrapper[4807]: I1014 13:35:43.672676 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-e815-account-create-k9rrg" Oct 14 13:35:45.477604 master-0 kubenswrapper[4807]: I1014 13:35:45.477566 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:45.711937 master-0 kubenswrapper[4807]: I1014 13:35:45.711855 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"b7ba88448806c343595bbd13211e0b0354594a6490b7359f2d7727f1d1cac1c0"} Oct 14 13:35:45.711937 master-0 kubenswrapper[4807]: I1014 13:35:45.711924 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"2737cb505e58c4fc79ab8cd8868e874b29b595b9c846260af54c55c2828d289f"} Oct 14 13:35:45.711937 master-0 kubenswrapper[4807]: I1014 13:35:45.711938 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"70074bb29f76cff6090f72d19a499ecf48198f22341001b1af22ceb6bac28958"} Oct 14 13:35:45.711937 master-0 kubenswrapper[4807]: I1014 13:35:45.711949 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"ab5ab95c89ea11f5a9532fe567d606f50550e86ad23e4e2eb9f09dc415c14481"} Oct 14 13:35:48.747236 master-0 kubenswrapper[4807]: I1014 13:35:48.747141 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"0e141aa1f3e228684b0908603caeb560be369d55b62e6ae2f2ee3e39d296e55c"} Oct 14 13:35:48.747236 master-0 kubenswrapper[4807]: I1014 13:35:48.747217 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"14b42f245ee6203185ada63284247eecf7644d6c76b308e9118f0a653f03789e"} Oct 14 13:35:49.205889 master-0 kubenswrapper[4807]: I1014 13:35:49.205788 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-27b4-account-create-8hj4v"] Oct 14 13:35:49.206789 master-0 kubenswrapper[4807]: E1014 13:35:49.206729 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9e9b1f09-655a-4d72-9f24-7067135e6de0" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: I1014 13:35:49.206763 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e9b1f09-655a-4d72-9f24-7067135e6de0" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: E1014 13:35:49.208214 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="13e302d5-d89f-4a34-a041-eee10e251d24" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: I1014 13:35:49.208593 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="13e302d5-d89f-4a34-a041-eee10e251d24" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: E1014 13:35:49.208691 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="fe7bfab3-b4c5-4f22-b86c-d237c3edf145" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: I1014 13:35:49.208702 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe7bfab3-b4c5-4f22-b86c-d237c3edf145" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: E1014 13:35:49.208751 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="1122c4c0-d1a1-4b65-8e30-09a7ab543979" containerName="mariadb-account-create" Oct 14 13:35:49.209132 master-0 kubenswrapper[4807]: I1014 13:35:49.208861 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="1122c4c0-d1a1-4b65-8e30-09a7ab543979" containerName="mariadb-account-create" Oct 14 13:35:49.210529 master-0 kubenswrapper[4807]: I1014 13:35:49.210500 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="1122c4c0-d1a1-4b65-8e30-09a7ab543979" containerName="mariadb-account-create" Oct 14 13:35:49.210529 master-0 kubenswrapper[4807]: I1014 13:35:49.210533 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="fe7bfab3-b4c5-4f22-b86c-d237c3edf145" containerName="mariadb-account-create" Oct 14 13:35:49.210875 master-0 kubenswrapper[4807]: I1014 13:35:49.210551 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="13e302d5-d89f-4a34-a041-eee10e251d24" containerName="mariadb-account-create" Oct 14 13:35:49.210875 master-0 kubenswrapper[4807]: I1014 13:35:49.210568 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="9e9b1f09-655a-4d72-9f24-7067135e6de0" containerName="mariadb-account-create" Oct 14 13:35:49.211552 master-0 kubenswrapper[4807]: I1014 13:35:49.211494 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:49.214063 master-0 kubenswrapper[4807]: I1014 13:35:49.214017 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-db-secret" Oct 14 13:35:49.243965 master-0 kubenswrapper[4807]: I1014 13:35:49.229080 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-27b4-account-create-8hj4v"] Oct 14 13:35:49.339793 master-0 kubenswrapper[4807]: I1014 13:35:49.339720 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrv9h\" (UniqueName: \"kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h\") pod \"cinder-27b4-account-create-8hj4v\" (UID: \"ecc3d596-0e58-4527-ae07-c7e7abf57426\") " pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:49.442119 master-0 kubenswrapper[4807]: I1014 13:35:49.441673 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-nrv9h\" (UniqueName: \"kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h\") pod \"cinder-27b4-account-create-8hj4v\" (UID: \"ecc3d596-0e58-4527-ae07-c7e7abf57426\") " pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:49.467749 master-0 kubenswrapper[4807]: I1014 13:35:49.467574 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrv9h\" (UniqueName: \"kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h\") pod \"cinder-27b4-account-create-8hj4v\" (UID: \"ecc3d596-0e58-4527-ae07-c7e7abf57426\") " pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:49.532319 master-0 kubenswrapper[4807]: I1014 13:35:49.532246 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:49.766908 master-0 kubenswrapper[4807]: I1014 13:35:49.766802 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/swift-storage-0" event={"ID":"68fbeea1-cbf0-44b7-a159-08369455b5e6","Type":"ContainerStarted","Data":"0c4404e61d8852aefb2032d6987eceba09656ccc886ddc9c19ff95ed0f0b7a05"} Oct 14 13:35:49.851486 master-0 kubenswrapper[4807]: I1014 13:35:49.847832 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/swift-storage-0" podStartSLOduration=23.670390034 podStartE2EDuration="40.847801398s" podCreationTimestamp="2025-10-14 13:35:09 +0000 UTC" firstStartedPulling="2025-10-14 13:35:31.036110584 +0000 UTC m=+925.717412418" lastFinishedPulling="2025-10-14 13:35:48.213521948 +0000 UTC m=+942.894823782" observedRunningTime="2025-10-14 13:35:49.840730299 +0000 UTC m=+944.522032133" watchObservedRunningTime="2025-10-14 13:35:49.847801398 +0000 UTC m=+944.529103222" Oct 14 13:35:50.037819 master-0 kubenswrapper[4807]: I1014 13:35:50.037743 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-27b4-account-create-8hj4v"] Oct 14 13:35:50.803017 master-0 kubenswrapper[4807]: I1014 13:35:50.802852 4807 generic.go:334] "Generic (PLEG): container finished" podID="ecc3d596-0e58-4527-ae07-c7e7abf57426" containerID="be206c55f79e147d0db49ff0691c1e94ca42a5b9ecf3f597dc37dad8d97959d2" exitCode=0 Oct 14 13:35:50.804407 master-0 kubenswrapper[4807]: I1014 13:35:50.803191 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-27b4-account-create-8hj4v" event={"ID":"ecc3d596-0e58-4527-ae07-c7e7abf57426","Type":"ContainerDied","Data":"be206c55f79e147d0db49ff0691c1e94ca42a5b9ecf3f597dc37dad8d97959d2"} Oct 14 13:35:50.804407 master-0 kubenswrapper[4807]: I1014 13:35:50.803249 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-27b4-account-create-8hj4v" event={"ID":"ecc3d596-0e58-4527-ae07-c7e7abf57426","Type":"ContainerStarted","Data":"4d179ed8164f2e2a354c4ef32405ac3e581c58da4a34dd60c1baee7923c78860"} Oct 14 13:35:51.302910 master-0 kubenswrapper[4807]: I1014 13:35:51.302834 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-db-create-t64s7"] Oct 14 13:35:51.305596 master-0 kubenswrapper[4807]: I1014 13:35:51.305563 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:51.438271 master-0 kubenswrapper[4807]: I1014 13:35:51.438185 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-t64s7"] Oct 14 13:35:51.496026 master-0 kubenswrapper[4807]: I1014 13:35:51.495968 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xwn24\" (UniqueName: \"kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24\") pod \"ironic-db-create-t64s7\" (UID: \"06503d41-6114-4621-9118-71f452042e07\") " pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:51.597808 master-0 kubenswrapper[4807]: I1014 13:35:51.597739 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xwn24\" (UniqueName: \"kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24\") pod \"ironic-db-create-t64s7\" (UID: \"06503d41-6114-4621-9118-71f452042e07\") " pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:51.718997 master-0 kubenswrapper[4807]: I1014 13:35:51.718916 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xwn24\" (UniqueName: \"kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24\") pod \"ironic-db-create-t64s7\" (UID: \"06503d41-6114-4621-9118-71f452042e07\") " pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:51.928010 master-0 kubenswrapper[4807]: I1014 13:35:51.926656 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:52.155059 master-0 kubenswrapper[4807]: I1014 13:35:52.155000 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:52.321685 master-0 kubenswrapper[4807]: I1014 13:35:52.320429 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrv9h\" (UniqueName: \"kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h\") pod \"ecc3d596-0e58-4527-ae07-c7e7abf57426\" (UID: \"ecc3d596-0e58-4527-ae07-c7e7abf57426\") " Oct 14 13:35:52.324392 master-0 kubenswrapper[4807]: I1014 13:35:52.324272 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h" (OuterVolumeSpecName: "kube-api-access-nrv9h") pod "ecc3d596-0e58-4527-ae07-c7e7abf57426" (UID: "ecc3d596-0e58-4527-ae07-c7e7abf57426"). InnerVolumeSpecName "kube-api-access-nrv9h". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:52.399196 master-0 kubenswrapper[4807]: I1014 13:35:52.399108 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-db-create-t64s7"] Oct 14 13:35:52.406450 master-0 kubenswrapper[4807]: W1014 13:35:52.406392 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06503d41_6114_4621_9118_71f452042e07.slice/crio-360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7 WatchSource:0}: Error finding container 360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7: Status 404 returned error can't find the container with id 360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7 Oct 14 13:35:52.423749 master-0 kubenswrapper[4807]: I1014 13:35:52.423693 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-nrv9h\" (UniqueName: \"kubernetes.io/projected/ecc3d596-0e58-4527-ae07-c7e7abf57426-kube-api-access-nrv9h\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:52.828471 master-0 kubenswrapper[4807]: I1014 13:35:52.828375 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-27b4-account-create-8hj4v" event={"ID":"ecc3d596-0e58-4527-ae07-c7e7abf57426","Type":"ContainerDied","Data":"4d179ed8164f2e2a354c4ef32405ac3e581c58da4a34dd60c1baee7923c78860"} Oct 14 13:35:52.828783 master-0 kubenswrapper[4807]: I1014 13:35:52.828428 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-27b4-account-create-8hj4v" Oct 14 13:35:52.828783 master-0 kubenswrapper[4807]: I1014 13:35:52.828470 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d179ed8164f2e2a354c4ef32405ac3e581c58da4a34dd60c1baee7923c78860" Oct 14 13:35:52.832197 master-0 kubenswrapper[4807]: I1014 13:35:52.832088 4807 generic.go:334] "Generic (PLEG): container finished" podID="06503d41-6114-4621-9118-71f452042e07" containerID="4076ef786e84915bcc38b61a8e249077657b5424387ac2f1910c2dc17cd9a886" exitCode=0 Oct 14 13:35:52.832197 master-0 kubenswrapper[4807]: I1014 13:35:52.832151 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-t64s7" event={"ID":"06503d41-6114-4621-9118-71f452042e07","Type":"ContainerDied","Data":"4076ef786e84915bcc38b61a8e249077657b5424387ac2f1910c2dc17cd9a886"} Oct 14 13:35:52.832197 master-0 kubenswrapper[4807]: I1014 13:35:52.832188 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-t64s7" event={"ID":"06503d41-6114-4621-9118-71f452042e07","Type":"ContainerStarted","Data":"360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7"} Oct 14 13:35:54.308108 master-0 kubenswrapper[4807]: I1014 13:35:54.307988 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:54.465491 master-0 kubenswrapper[4807]: I1014 13:35:54.464623 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xwn24\" (UniqueName: \"kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24\") pod \"06503d41-6114-4621-9118-71f452042e07\" (UID: \"06503d41-6114-4621-9118-71f452042e07\") " Oct 14 13:35:54.470475 master-0 kubenswrapper[4807]: I1014 13:35:54.468245 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24" (OuterVolumeSpecName: "kube-api-access-xwn24") pod "06503d41-6114-4621-9118-71f452042e07" (UID: "06503d41-6114-4621-9118-71f452042e07"). InnerVolumeSpecName "kube-api-access-xwn24". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:35:54.567661 master-0 kubenswrapper[4807]: I1014 13:35:54.567510 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xwn24\" (UniqueName: \"kubernetes.io/projected/06503d41-6114-4621-9118-71f452042e07-kube-api-access-xwn24\") on node \"master-0\" DevicePath \"\"" Oct 14 13:35:54.849420 master-0 kubenswrapper[4807]: I1014 13:35:54.849183 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-db-create-t64s7" event={"ID":"06503d41-6114-4621-9118-71f452042e07","Type":"ContainerDied","Data":"360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7"} Oct 14 13:35:54.849420 master-0 kubenswrapper[4807]: I1014 13:35:54.849274 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="360be77a5fe521f72395fcddc16ec4cd62e0f2b8db6d240022ec81c62b06c4e7" Oct 14 13:35:54.849420 master-0 kubenswrapper[4807]: I1014 13:35:54.849376 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-db-create-t64s7" Oct 14 13:35:55.478133 master-0 kubenswrapper[4807]: I1014 13:35:55.478055 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:55.493278 master-0 kubenswrapper[4807]: I1014 13:35:55.493225 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/prometheus-metric-storage-0" Oct 14 13:35:55.862326 master-0 kubenswrapper[4807]: I1014 13:35:55.862262 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/prometheus-metric-storage-0" Oct 14 13:36:01.165572 master-0 kubenswrapper[4807]: I1014 13:36:01.165357 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-c7da-account-create-rnsqw"] Oct 14 13:36:01.174929 master-0 kubenswrapper[4807]: E1014 13:36:01.165877 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="ecc3d596-0e58-4527-ae07-c7e7abf57426" containerName="mariadb-account-create" Oct 14 13:36:01.174929 master-0 kubenswrapper[4807]: I1014 13:36:01.165904 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc3d596-0e58-4527-ae07-c7e7abf57426" containerName="mariadb-account-create" Oct 14 13:36:01.174929 master-0 kubenswrapper[4807]: E1014 13:36:01.165925 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="06503d41-6114-4621-9118-71f452042e07" containerName="mariadb-database-create" Oct 14 13:36:01.174929 master-0 kubenswrapper[4807]: I1014 13:36:01.165937 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="06503d41-6114-4621-9118-71f452042e07" containerName="mariadb-database-create" Oct 14 13:36:01.177658 master-0 kubenswrapper[4807]: I1014 13:36:01.177618 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="06503d41-6114-4621-9118-71f452042e07" containerName="mariadb-database-create" Oct 14 13:36:01.177730 master-0 kubenswrapper[4807]: I1014 13:36:01.177673 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="ecc3d596-0e58-4527-ae07-c7e7abf57426" containerName="mariadb-account-create" Oct 14 13:36:01.178752 master-0 kubenswrapper[4807]: I1014 13:36:01.178717 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:01.181535 master-0 kubenswrapper[4807]: I1014 13:36:01.181498 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-db-secret" Oct 14 13:36:01.195482 master-0 kubenswrapper[4807]: I1014 13:36:01.194791 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-c7da-account-create-rnsqw"] Oct 14 13:36:01.293341 master-0 kubenswrapper[4807]: I1014 13:36:01.293256 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg5kt\" (UniqueName: \"kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt\") pod \"ironic-c7da-account-create-rnsqw\" (UID: \"7b5b1db5-657d-413a-aeee-5e085a79ea7e\") " pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:01.395968 master-0 kubenswrapper[4807]: I1014 13:36:01.395889 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-bg5kt\" (UniqueName: \"kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt\") pod \"ironic-c7da-account-create-rnsqw\" (UID: \"7b5b1db5-657d-413a-aeee-5e085a79ea7e\") " pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:01.419801 master-0 kubenswrapper[4807]: I1014 13:36:01.419642 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg5kt\" (UniqueName: \"kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt\") pod \"ironic-c7da-account-create-rnsqw\" (UID: \"7b5b1db5-657d-413a-aeee-5e085a79ea7e\") " pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:01.539139 master-0 kubenswrapper[4807]: I1014 13:36:01.539035 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:02.146761 master-0 kubenswrapper[4807]: W1014 13:36:02.145696 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b5b1db5_657d_413a_aeee_5e085a79ea7e.slice/crio-54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4 WatchSource:0}: Error finding container 54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4: Status 404 returned error can't find the container with id 54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4 Oct 14 13:36:02.318037 master-0 kubenswrapper[4807]: I1014 13:36:02.317953 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-c7da-account-create-rnsqw"] Oct 14 13:36:02.917490 master-0 kubenswrapper[4807]: I1014 13:36:02.917388 4807 generic.go:334] "Generic (PLEG): container finished" podID="7b5b1db5-657d-413a-aeee-5e085a79ea7e" containerID="843b898a552f800a5ca6f35b22d9e2b0d28fa70caf8132d25998368a2a17e015" exitCode=0 Oct 14 13:36:02.917490 master-0 kubenswrapper[4807]: I1014 13:36:02.917484 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-c7da-account-create-rnsqw" event={"ID":"7b5b1db5-657d-413a-aeee-5e085a79ea7e","Type":"ContainerDied","Data":"843b898a552f800a5ca6f35b22d9e2b0d28fa70caf8132d25998368a2a17e015"} Oct 14 13:36:02.917824 master-0 kubenswrapper[4807]: I1014 13:36:02.917524 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-c7da-account-create-rnsqw" event={"ID":"7b5b1db5-657d-413a-aeee-5e085a79ea7e","Type":"ContainerStarted","Data":"54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4"} Oct 14 13:36:04.335778 master-0 kubenswrapper[4807]: I1014 13:36:04.335711 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:04.457486 master-0 kubenswrapper[4807]: I1014 13:36:04.457390 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg5kt\" (UniqueName: \"kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt\") pod \"7b5b1db5-657d-413a-aeee-5e085a79ea7e\" (UID: \"7b5b1db5-657d-413a-aeee-5e085a79ea7e\") " Oct 14 13:36:04.461940 master-0 kubenswrapper[4807]: I1014 13:36:04.461866 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt" (OuterVolumeSpecName: "kube-api-access-bg5kt") pod "7b5b1db5-657d-413a-aeee-5e085a79ea7e" (UID: "7b5b1db5-657d-413a-aeee-5e085a79ea7e"). InnerVolumeSpecName "kube-api-access-bg5kt". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:36:04.560296 master-0 kubenswrapper[4807]: I1014 13:36:04.560119 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-bg5kt\" (UniqueName: \"kubernetes.io/projected/7b5b1db5-657d-413a-aeee-5e085a79ea7e-kube-api-access-bg5kt\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:04.940265 master-0 kubenswrapper[4807]: I1014 13:36:04.940176 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-c7da-account-create-rnsqw" event={"ID":"7b5b1db5-657d-413a-aeee-5e085a79ea7e","Type":"ContainerDied","Data":"54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4"} Oct 14 13:36:04.940265 master-0 kubenswrapper[4807]: I1014 13:36:04.940237 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54b70634f9a882512a57627dafbc0934a6a990d31c7003635d1c1cb59be202f4" Oct 14 13:36:04.940634 master-0 kubenswrapper[4807]: I1014 13:36:04.940295 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-c7da-account-create-rnsqw" Oct 14 13:36:12.586579 master-0 kubenswrapper[4807]: I1014 13:36:12.586285 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:36:12.587438 master-0 kubenswrapper[4807]: I1014 13:36:12.586654 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="dnsmasq-dns" containerID="cri-o://bca282b9ecd428681c42986c3fb6fbe668e710435b688758c102c5757202f56d" gracePeriod=10 Oct 14 13:36:13.014405 master-0 kubenswrapper[4807]: I1014 13:36:13.014323 4807 generic.go:334] "Generic (PLEG): container finished" podID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerID="bca282b9ecd428681c42986c3fb6fbe668e710435b688758c102c5757202f56d" exitCode=0 Oct 14 13:36:13.014405 master-0 kubenswrapper[4807]: I1014 13:36:13.014385 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerDied","Data":"bca282b9ecd428681c42986c3fb6fbe668e710435b688758c102c5757202f56d"} Oct 14 13:36:13.120037 master-0 kubenswrapper[4807]: I1014 13:36:13.119956 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:36:13.233268 master-0 kubenswrapper[4807]: I1014 13:36:13.233146 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb\") pod \"6f467642-b1df-446a-8b9b-6aadf9a4332d\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " Oct 14 13:36:13.233268 master-0 kubenswrapper[4807]: I1014 13:36:13.233261 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb\") pod \"6f467642-b1df-446a-8b9b-6aadf9a4332d\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " Oct 14 13:36:13.233769 master-0 kubenswrapper[4807]: I1014 13:36:13.233319 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ks2qx\" (UniqueName: \"kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx\") pod \"6f467642-b1df-446a-8b9b-6aadf9a4332d\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " Oct 14 13:36:13.233769 master-0 kubenswrapper[4807]: I1014 13:36:13.233416 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config\") pod \"6f467642-b1df-446a-8b9b-6aadf9a4332d\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " Oct 14 13:36:13.233769 master-0 kubenswrapper[4807]: I1014 13:36:13.233455 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc\") pod \"6f467642-b1df-446a-8b9b-6aadf9a4332d\" (UID: \"6f467642-b1df-446a-8b9b-6aadf9a4332d\") " Oct 14 13:36:13.240184 master-0 kubenswrapper[4807]: I1014 13:36:13.240052 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx" (OuterVolumeSpecName: "kube-api-access-ks2qx") pod "6f467642-b1df-446a-8b9b-6aadf9a4332d" (UID: "6f467642-b1df-446a-8b9b-6aadf9a4332d"). InnerVolumeSpecName "kube-api-access-ks2qx". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:36:13.267622 master-0 kubenswrapper[4807]: I1014 13:36:13.267345 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "6f467642-b1df-446a-8b9b-6aadf9a4332d" (UID: "6f467642-b1df-446a-8b9b-6aadf9a4332d"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:13.273414 master-0 kubenswrapper[4807]: I1014 13:36:13.273270 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "6f467642-b1df-446a-8b9b-6aadf9a4332d" (UID: "6f467642-b1df-446a-8b9b-6aadf9a4332d"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:13.277501 master-0 kubenswrapper[4807]: I1014 13:36:13.277399 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "6f467642-b1df-446a-8b9b-6aadf9a4332d" (UID: "6f467642-b1df-446a-8b9b-6aadf9a4332d"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:13.299105 master-0 kubenswrapper[4807]: I1014 13:36:13.298854 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config" (OuterVolumeSpecName: "config") pod "6f467642-b1df-446a-8b9b-6aadf9a4332d" (UID: "6f467642-b1df-446a-8b9b-6aadf9a4332d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:13.335605 master-0 kubenswrapper[4807]: I1014 13:36:13.335535 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:13.335605 master-0 kubenswrapper[4807]: I1014 13:36:13.335584 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-ks2qx\" (UniqueName: \"kubernetes.io/projected/6f467642-b1df-446a-8b9b-6aadf9a4332d-kube-api-access-ks2qx\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:13.335605 master-0 kubenswrapper[4807]: I1014 13:36:13.335602 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:13.335605 master-0 kubenswrapper[4807]: I1014 13:36:13.335612 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:13.335605 master-0 kubenswrapper[4807]: I1014 13:36:13.335622 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/6f467642-b1df-446a-8b9b-6aadf9a4332d-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:14.025491 master-0 kubenswrapper[4807]: I1014 13:36:14.025398 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" event={"ID":"6f467642-b1df-446a-8b9b-6aadf9a4332d","Type":"ContainerDied","Data":"a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d"} Oct 14 13:36:14.025491 master-0 kubenswrapper[4807]: I1014 13:36:14.025473 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-68f9c67449-hlrvr" Oct 14 13:36:14.025491 master-0 kubenswrapper[4807]: I1014 13:36:14.025499 4807 scope.go:117] "RemoveContainer" containerID="bca282b9ecd428681c42986c3fb6fbe668e710435b688758c102c5757202f56d" Oct 14 13:36:14.046344 master-0 kubenswrapper[4807]: I1014 13:36:14.046294 4807 scope.go:117] "RemoveContainer" containerID="c045ffa99aea9933c2e053ad45abc365d421f6217fa10d41696c636439ff50b9" Oct 14 13:36:14.096242 master-0 kubenswrapper[4807]: I1014 13:36:14.096175 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:36:14.101786 master-0 kubenswrapper[4807]: I1014 13:36:14.101724 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-68f9c67449-hlrvr"] Oct 14 13:36:14.122937 master-0 kubenswrapper[4807]: E1014 13:36:14.122861 4807 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f467642_b1df_446a_8b9b_6aadf9a4332d.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f467642_b1df_446a_8b9b_6aadf9a4332d.slice/crio-a51a09c4146c302f9b14bafa61a27aa1f19b1ffe84f026e73bff88086e28207d\": RecentStats: unable to find data in memory cache]" Oct 14 13:36:14.270692 master-0 kubenswrapper[4807]: I1014 13:36:14.270624 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" path="/var/lib/kubelet/pods/6f467642-b1df-446a-8b9b-6aadf9a4332d/volumes" Oct 14 13:36:15.515375 master-0 kubenswrapper[4807]: I1014 13:36:15.515292 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/keystone-5755976884-dmt6m"] Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: E1014 13:36:15.515724 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="dnsmasq-dns" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: I1014 13:36:15.515745 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="dnsmasq-dns" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: E1014 13:36:15.515769 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7b5b1db5-657d-413a-aeee-5e085a79ea7e" containerName="mariadb-account-create" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: I1014 13:36:15.515779 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b1db5-657d-413a-aeee-5e085a79ea7e" containerName="mariadb-account-create" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: E1014 13:36:15.515793 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="init" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: I1014 13:36:15.515802 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="init" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: I1014 13:36:15.515970 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="6f467642-b1df-446a-8b9b-6aadf9a4332d" containerName="dnsmasq-dns" Oct 14 13:36:15.516021 master-0 kubenswrapper[4807]: I1014 13:36:15.515983 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="7b5b1db5-657d-413a-aeee-5e085a79ea7e" containerName="mariadb-account-create" Oct 14 13:36:15.516725 master-0 kubenswrapper[4807]: I1014 13:36:15.516688 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.557230 master-0 kubenswrapper[4807]: I1014 13:36:15.557137 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-internal-svc" Oct 14 13:36:15.557230 master-0 kubenswrapper[4807]: I1014 13:36:15.557157 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-scripts" Oct 14 13:36:15.557615 master-0 kubenswrapper[4807]: I1014 13:36:15.557296 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone" Oct 14 13:36:15.557615 master-0 kubenswrapper[4807]: I1014 13:36:15.557437 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-keystone-public-svc" Oct 14 13:36:15.557747 master-0 kubenswrapper[4807]: I1014 13:36:15.557710 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"keystone-config-data" Oct 14 13:36:15.567942 master-0 kubenswrapper[4807]: I1014 13:36:15.567855 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-5755976884-dmt6m"] Oct 14 13:36:15.679194 master-0 kubenswrapper[4807]: I1014 13:36:15.679108 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-credential-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.679194 master-0 kubenswrapper[4807]: I1014 13:36:15.679189 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-config-data\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.679822 master-0 kubenswrapper[4807]: I1014 13:36:15.679269 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-internal-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.679907 master-0 kubenswrapper[4807]: I1014 13:36:15.679845 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-fernet-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.680726 master-0 kubenswrapper[4807]: I1014 13:36:15.680682 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jxkg\" (UniqueName: \"kubernetes.io/projected/2778fed8-444a-4bc8-99d0-5c0ec780447a-kube-api-access-6jxkg\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.680800 master-0 kubenswrapper[4807]: I1014 13:36:15.680751 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-scripts\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.681030 master-0 kubenswrapper[4807]: I1014 13:36:15.680996 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-public-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.681124 master-0 kubenswrapper[4807]: I1014 13:36:15.681088 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-combined-ca-bundle\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784112 master-0 kubenswrapper[4807]: I1014 13:36:15.783923 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6jxkg\" (UniqueName: \"kubernetes.io/projected/2778fed8-444a-4bc8-99d0-5c0ec780447a-kube-api-access-6jxkg\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784112 master-0 kubenswrapper[4807]: I1014 13:36:15.784042 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-scripts\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784112 master-0 kubenswrapper[4807]: I1014 13:36:15.784093 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-public-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784510 master-0 kubenswrapper[4807]: I1014 13:36:15.784121 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-combined-ca-bundle\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784510 master-0 kubenswrapper[4807]: I1014 13:36:15.784157 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-credential-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784510 master-0 kubenswrapper[4807]: I1014 13:36:15.784182 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-config-data\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784510 master-0 kubenswrapper[4807]: I1014 13:36:15.784210 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-internal-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.784510 master-0 kubenswrapper[4807]: I1014 13:36:15.784259 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-fernet-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.788677 master-0 kubenswrapper[4807]: I1014 13:36:15.788388 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"credential-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-credential-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.788863 master-0 kubenswrapper[4807]: I1014 13:36:15.788685 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-scripts\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.788863 master-0 kubenswrapper[4807]: I1014 13:36:15.788800 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-public-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.789415 master-0 kubenswrapper[4807]: I1014 13:36:15.789346 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-combined-ca-bundle\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.790160 master-0 kubenswrapper[4807]: I1014 13:36:15.790098 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-config-data\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.791642 master-0 kubenswrapper[4807]: I1014 13:36:15.791583 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"fernet-keys\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-fernet-keys\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.791785 master-0 kubenswrapper[4807]: I1014 13:36:15.791730 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/2778fed8-444a-4bc8-99d0-5c0ec780447a-internal-tls-certs\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.805874 master-0 kubenswrapper[4807]: I1014 13:36:15.805824 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jxkg\" (UniqueName: \"kubernetes.io/projected/2778fed8-444a-4bc8-99d0-5c0ec780447a-kube-api-access-6jxkg\") pod \"keystone-5755976884-dmt6m\" (UID: \"2778fed8-444a-4bc8-99d0-5c0ec780447a\") " pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:15.884633 master-0 kubenswrapper[4807]: I1014 13:36:15.884557 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:16.332538 master-0 kubenswrapper[4807]: I1014 13:36:16.332208 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/keystone-5755976884-dmt6m"] Oct 14 13:36:17.064664 master-0 kubenswrapper[4807]: I1014 13:36:17.064532 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-5755976884-dmt6m" event={"ID":"2778fed8-444a-4bc8-99d0-5c0ec780447a","Type":"ContainerStarted","Data":"3ae776d88d14dabd3c43fb11f0ba2813910e7e3665127dc0ce719822115198a5"} Oct 14 13:36:20.314718 master-0 kubenswrapper[4807]: I1014 13:36:20.314573 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/placement-958c54db4-xtfr6"] Oct 14 13:36:20.318286 master-0 kubenswrapper[4807]: I1014 13:36:20.318236 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.320941 master-0 kubenswrapper[4807]: I1014 13:36:20.320914 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-internal-svc" Oct 14 13:36:20.321632 master-0 kubenswrapper[4807]: I1014 13:36:20.321586 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-placement-public-svc" Oct 14 13:36:20.322038 master-0 kubenswrapper[4807]: I1014 13:36:20.321990 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-config-data" Oct 14 13:36:20.324881 master-0 kubenswrapper[4807]: I1014 13:36:20.324844 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"placement-scripts" Oct 14 13:36:20.342664 master-0 kubenswrapper[4807]: I1014 13:36:20.342593 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-958c54db4-xtfr6"] Oct 14 13:36:20.382652 master-0 kubenswrapper[4807]: I1014 13:36:20.382578 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-scripts\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.382652 master-0 kubenswrapper[4807]: I1014 13:36:20.382640 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-combined-ca-bundle\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.382790 master-0 kubenswrapper[4807]: I1014 13:36:20.382686 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcqcf\" (UniqueName: \"kubernetes.io/projected/548e2aee-5275-43aa-b2a0-40138acfe4ca-kube-api-access-lcqcf\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.382790 master-0 kubenswrapper[4807]: I1014 13:36:20.382708 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-public-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.382790 master-0 kubenswrapper[4807]: I1014 13:36:20.382731 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-config-data\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.382790 master-0 kubenswrapper[4807]: I1014 13:36:20.382777 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/548e2aee-5275-43aa-b2a0-40138acfe4ca-logs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.383686 master-0 kubenswrapper[4807]: I1014 13:36:20.382805 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-internal-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484341 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/548e2aee-5275-43aa-b2a0-40138acfe4ca-logs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484609 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-internal-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484661 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-scripts\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484736 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-combined-ca-bundle\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484771 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lcqcf\" (UniqueName: \"kubernetes.io/projected/548e2aee-5275-43aa-b2a0-40138acfe4ca-kube-api-access-lcqcf\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484810 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-public-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.485818 master-0 kubenswrapper[4807]: I1014 13:36:20.484840 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-config-data\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.486370 master-0 kubenswrapper[4807]: I1014 13:36:20.486254 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/548e2aee-5275-43aa-b2a0-40138acfe4ca-logs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.488835 master-0 kubenswrapper[4807]: I1014 13:36:20.488773 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-scripts\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.489427 master-0 kubenswrapper[4807]: I1014 13:36:20.489373 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-config-data\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.490134 master-0 kubenswrapper[4807]: I1014 13:36:20.490099 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-internal-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.491613 master-0 kubenswrapper[4807]: I1014 13:36:20.491558 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-combined-ca-bundle\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.491710 master-0 kubenswrapper[4807]: I1014 13:36:20.491615 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/548e2aee-5275-43aa-b2a0-40138acfe4ca-public-tls-certs\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.507826 master-0 kubenswrapper[4807]: I1014 13:36:20.507763 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcqcf\" (UniqueName: \"kubernetes.io/projected/548e2aee-5275-43aa-b2a0-40138acfe4ca-kube-api-access-lcqcf\") pod \"placement-958c54db4-xtfr6\" (UID: \"548e2aee-5275-43aa-b2a0-40138acfe4ca\") " pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:20.640335 master-0 kubenswrapper[4807]: I1014 13:36:20.640266 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:21.119573 master-0 kubenswrapper[4807]: I1014 13:36:21.102718 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/keystone-5755976884-dmt6m" event={"ID":"2778fed8-444a-4bc8-99d0-5c0ec780447a","Type":"ContainerStarted","Data":"edd588a9cddd91a9a28e54380fd0cbebd63e3946de000f96aef2de75e1e6205e"} Oct 14 13:36:21.119573 master-0 kubenswrapper[4807]: I1014 13:36:21.102988 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:21.178431 master-0 kubenswrapper[4807]: I1014 13:36:21.177837 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/placement-958c54db4-xtfr6"] Oct 14 13:36:21.180718 master-0 kubenswrapper[4807]: W1014 13:36:21.180617 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod548e2aee_5275_43aa_b2a0_40138acfe4ca.slice/crio-0e949e9ff5099e296710625b5b62e0eed32c241b16c0c1752e5dc4cbe34c0651 WatchSource:0}: Error finding container 0e949e9ff5099e296710625b5b62e0eed32c241b16c0c1752e5dc4cbe34c0651: Status 404 returned error can't find the container with id 0e949e9ff5099e296710625b5b62e0eed32c241b16c0c1752e5dc4cbe34c0651 Oct 14 13:36:21.379567 master-0 kubenswrapper[4807]: I1014 13:36:21.378901 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/keystone-5755976884-dmt6m" podStartSLOduration=2.234390043 podStartE2EDuration="6.378870695s" podCreationTimestamp="2025-10-14 13:36:15 +0000 UTC" firstStartedPulling="2025-10-14 13:36:16.353727806 +0000 UTC m=+971.035029630" lastFinishedPulling="2025-10-14 13:36:20.498208458 +0000 UTC m=+975.179510282" observedRunningTime="2025-10-14 13:36:21.374791404 +0000 UTC m=+976.056093228" watchObservedRunningTime="2025-10-14 13:36:21.378870695 +0000 UTC m=+976.060172519" Oct 14 13:36:22.113333 master-0 kubenswrapper[4807]: I1014 13:36:22.113263 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-958c54db4-xtfr6" event={"ID":"548e2aee-5275-43aa-b2a0-40138acfe4ca","Type":"ContainerStarted","Data":"0e949e9ff5099e296710625b5b62e0eed32c241b16c0c1752e5dc4cbe34c0651"} Oct 14 13:36:24.131844 master-0 kubenswrapper[4807]: I1014 13:36:24.131787 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-958c54db4-xtfr6" event={"ID":"548e2aee-5275-43aa-b2a0-40138acfe4ca","Type":"ContainerStarted","Data":"153cbb43de73db80007fb2339e9f1e79f9ee272813be43a64e22e0e59054910a"} Oct 14 13:36:25.082946 master-0 kubenswrapper[4807]: I1014 13:36:25.082870 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:25.084912 master-0 kubenswrapper[4807]: I1014 13:36:25.084853 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.090643 master-0 kubenswrapper[4807]: I1014 13:36:25.090596 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:36:25.090812 master-0 kubenswrapper[4807]: I1014 13:36:25.090651 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Oct 14 13:36:25.090812 master-0 kubenswrapper[4807]: I1014 13:36:25.090688 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:36:25.090915 master-0 kubenswrapper[4807]: I1014 13:36:25.090826 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:36:25.091362 master-0 kubenswrapper[4807]: I1014 13:36:25.091106 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:36:25.141139 master-0 kubenswrapper[4807]: I1014 13:36:25.141008 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/placement-958c54db4-xtfr6" event={"ID":"548e2aee-5275-43aa-b2a0-40138acfe4ca","Type":"ContainerStarted","Data":"ceb0b1486f102cbc224cc510ba1696ba0fa6adb89e9191239a796bbe101730ab"} Oct 14 13:36:25.141968 master-0 kubenswrapper[4807]: I1014 13:36:25.141933 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:25.142031 master-0 kubenswrapper[4807]: I1014 13:36:25.141979 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:25.172585 master-0 kubenswrapper[4807]: I1014 13:36:25.171896 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:25.180269 master-0 kubenswrapper[4807]: I1014 13:36:25.180202 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.180492 master-0 kubenswrapper[4807]: I1014 13:36:25.180293 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.180492 master-0 kubenswrapper[4807]: I1014 13:36:25.180365 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.180492 master-0 kubenswrapper[4807]: I1014 13:36:25.180396 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djvdv\" (UniqueName: \"kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.180492 master-0 kubenswrapper[4807]: I1014 13:36:25.180481 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.180685 master-0 kubenswrapper[4807]: I1014 13:36:25.180532 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282427 master-0 kubenswrapper[4807]: I1014 13:36:25.282353 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282717 master-0 kubenswrapper[4807]: I1014 13:36:25.282477 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282717 master-0 kubenswrapper[4807]: I1014 13:36:25.282568 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282717 master-0 kubenswrapper[4807]: I1014 13:36:25.282633 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282717 master-0 kubenswrapper[4807]: I1014 13:36:25.282691 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.282918 master-0 kubenswrapper[4807]: I1014 13:36:25.282724 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-djvdv\" (UniqueName: \"kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.283596 master-0 kubenswrapper[4807]: I1014 13:36:25.283428 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.283981 master-0 kubenswrapper[4807]: I1014 13:36:25.283765 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.284364 master-0 kubenswrapper[4807]: I1014 13:36:25.284287 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.284364 master-0 kubenswrapper[4807]: I1014 13:36:25.284319 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.284609 master-0 kubenswrapper[4807]: I1014 13:36:25.284554 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.388436 master-0 kubenswrapper[4807]: I1014 13:36:25.388323 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/placement-958c54db4-xtfr6" podStartSLOduration=2.683035528 podStartE2EDuration="5.388295364s" podCreationTimestamp="2025-10-14 13:36:20 +0000 UTC" firstStartedPulling="2025-10-14 13:36:21.18269566 +0000 UTC m=+975.863997504" lastFinishedPulling="2025-10-14 13:36:23.887955516 +0000 UTC m=+978.569257340" observedRunningTime="2025-10-14 13:36:25.375960766 +0000 UTC m=+980.057262590" watchObservedRunningTime="2025-10-14 13:36:25.388295364 +0000 UTC m=+980.069597218" Oct 14 13:36:25.535031 master-0 kubenswrapper[4807]: I1014 13:36:25.534848 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-djvdv\" (UniqueName: \"kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv\") pod \"dnsmasq-dns-76965fd747-snwh6\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:25.700822 master-0 kubenswrapper[4807]: I1014 13:36:25.700749 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:26.277758 master-0 kubenswrapper[4807]: I1014 13:36:26.277677 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:36:26.279203 master-0 kubenswrapper[4807]: I1014 13:36:26.279162 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.282625 master-0 kubenswrapper[4807]: I1014 13:36:26.282548 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-config" Oct 14 13:36:26.282940 master-0 kubenswrapper[4807]: I1014 13:36:26.282855 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-ovndbs" Oct 14 13:36:26.283075 master-0 kubenswrapper[4807]: I1014 13:36:26.282996 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"neutron-httpd-config" Oct 14 13:36:26.374868 master-0 kubenswrapper[4807]: I1014 13:36:26.374782 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:36:26.393886 master-0 kubenswrapper[4807]: I1014 13:36:26.393800 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:26.405193 master-0 kubenswrapper[4807]: I1014 13:36:26.405143 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.405329 master-0 kubenswrapper[4807]: I1014 13:36:26.405302 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.405376 master-0 kubenswrapper[4807]: I1014 13:36:26.405332 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.406043 master-0 kubenswrapper[4807]: I1014 13:36:26.405424 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.406043 master-0 kubenswrapper[4807]: I1014 13:36:26.405493 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtq8j\" (UniqueName: \"kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.506963 master-0 kubenswrapper[4807]: I1014 13:36:26.506888 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.507132 master-0 kubenswrapper[4807]: I1014 13:36:26.506983 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.507132 master-0 kubenswrapper[4807]: I1014 13:36:26.507005 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.507132 master-0 kubenswrapper[4807]: I1014 13:36:26.507048 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.507132 master-0 kubenswrapper[4807]: I1014 13:36:26.507066 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dtq8j\" (UniqueName: \"kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.512496 master-0 kubenswrapper[4807]: I1014 13:36:26.512406 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.513071 master-0 kubenswrapper[4807]: I1014 13:36:26.513023 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.513312 master-0 kubenswrapper[4807]: I1014 13:36:26.513267 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.513420 master-0 kubenswrapper[4807]: I1014 13:36:26.513379 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.675883 master-0 kubenswrapper[4807]: I1014 13:36:26.675813 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtq8j\" (UniqueName: \"kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j\") pod \"neutron-55c4fcb4cb-sszff\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:26.916445 master-0 kubenswrapper[4807]: I1014 13:36:26.916333 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:27.160149 master-0 kubenswrapper[4807]: I1014 13:36:27.160095 4807 generic.go:334] "Generic (PLEG): container finished" podID="3302de2a-14e6-4970-a3b3-88304db4238d" containerID="9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420" exitCode=0 Oct 14 13:36:27.160394 master-0 kubenswrapper[4807]: I1014 13:36:27.160194 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-76965fd747-snwh6" event={"ID":"3302de2a-14e6-4970-a3b3-88304db4238d","Type":"ContainerDied","Data":"9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420"} Oct 14 13:36:27.160439 master-0 kubenswrapper[4807]: I1014 13:36:27.160380 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-76965fd747-snwh6" event={"ID":"3302de2a-14e6-4970-a3b3-88304db4238d","Type":"ContainerStarted","Data":"f9b576acbb4b316f2b974de5c3a34951673cf0ff196e8fd98973c675fcbbffac"} Oct 14 13:36:27.348898 master-0 kubenswrapper[4807]: E1014 13:36:27.348817 4807 log.go:32] "CreateContainer in sandbox from runtime service failed" err=< Oct 14 13:36:27.348898 master-0 kubenswrapper[4807]: rpc error: code = Unknown desc = container create failed: mount `/var/lib/kubelet/pods/3302de2a-14e6-4970-a3b3-88304db4238d/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Oct 14 13:36:27.348898 master-0 kubenswrapper[4807]: > podSandboxID="f9b576acbb4b316f2b974de5c3a34951673cf0ff196e8fd98973c675fcbbffac" Oct 14 13:36:27.349489 master-0 kubenswrapper[4807]: E1014 13:36:27.349102 4807 kuberuntime_manager.go:1274] "Unhandled Error" err=< Oct 14 13:36:27.349489 master-0 kubenswrapper[4807]: container &Container{Name:dnsmasq-dns,Image:quay.io/podified-antelope-centos9/openstack-neutron-server@sha256:673685cea6ea2dbd78bcb555955c1b9f05ea26018f79ee34494256a5f2d7b74a,Command:[/bin/bash],Args:[-c dnsmasq --interface=* --conf-dir=/etc/dnsmasq.d --hostsdir=/etc/dnsmasq.d/hosts --keep-in-foreground --log-debug --bind-interfaces --listen-address=$(POD_IP) --port 5353 --log-facility=- --no-hosts --domain-needed --no-resolv --bogus-priv --log-queries],WorkingDir:,Ports:[]ContainerPort{},Env:[]EnvVar{EnvVar{Name:CONFIG_HASH,Value:nf6hd5h8fh578h68h8dh64chcch78hddhb9h86h679h7bh4hb5h5h8fhf6h4h567h649h66bh595h556h579hd7h5c7h8fh97h65h58dq,ValueFrom:nil,},EnvVar{Name:POD_IP,Value:,ValueFrom:&EnvVarSource{FieldRef:&ObjectFieldSelector{APIVersion:v1,FieldPath:status.podIP,},ResourceFieldRef:nil,ConfigMapKeyRef:nil,SecretKeyRef:nil,},},},Resources:ResourceRequirements{Limits:ResourceList{},Requests:ResourceList{},Claims:[]ResourceClaim{},},VolumeMounts:[]VolumeMount{VolumeMount{Name:config,ReadOnly:true,MountPath:/etc/dnsmasq.d/config.cfg,SubPath:dns,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dns-svc,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dns-svc,SubPath:dns-svc,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:dns-swift-storage-0,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/dns-swift-storage-0,SubPath:dns-swift-storage-0,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-nb,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/ovsdbserver-nb,SubPath:ovsdbserver-nb,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:ovsdbserver-sb,ReadOnly:true,MountPath:/etc/dnsmasq.d/hosts/ovsdbserver-sb,SubPath:ovsdbserver-sb,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},VolumeMount{Name:kube-api-access-djvdv,ReadOnly:true,MountPath:/var/run/secrets/kubernetes.io/serviceaccount,SubPath:,MountPropagation:nil,SubPathExpr:,RecursiveReadOnly:nil,},},LivenessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:3,TimeoutSeconds:5,PeriodSeconds:3,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},ReadinessProbe:&Probe{ProbeHandler:ProbeHandler{Exec:nil,HTTPGet:nil,TCPSocket:&TCPSocketAction{Port:{0 5353 },Host:,},GRPC:nil,},InitialDelaySeconds:5,TimeoutSeconds:5,PeriodSeconds:5,SuccessThreshold:1,FailureThreshold:3,TerminationGracePeriodSeconds:nil,},Lifecycle:nil,TerminationMessagePath:/dev/termination-log,ImagePullPolicy:IfNotPresent,SecurityContext:&SecurityContext{Capabilities:&Capabilities{Add:[],Drop:[ALL],},Privileged:nil,SELinuxOptions:nil,RunAsUser:*1000790000,RunAsNonRoot:*true,ReadOnlyRootFilesystem:nil,AllowPrivilegeEscalation:*false,RunAsGroup:nil,ProcMount:nil,WindowsOptions:nil,SeccompProfile:&SeccompProfile{Type:RuntimeDefault,LocalhostProfile:nil,},AppArmorProfile:nil,},Stdin:false,StdinOnce:false,TTY:false,EnvFrom:[]EnvFromSource{},TerminationMessagePolicy:File,VolumeDevices:[]VolumeDevice{},StartupProbe:nil,ResizePolicy:[]ContainerResizePolicy{},RestartPolicy:nil,} start failed in pod dnsmasq-dns-76965fd747-snwh6_openstack(3302de2a-14e6-4970-a3b3-88304db4238d): CreateContainerError: container create failed: mount `/var/lib/kubelet/pods/3302de2a-14e6-4970-a3b3-88304db4238d/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory Oct 14 13:36:27.349489 master-0 kubenswrapper[4807]: > logger="UnhandledError" Oct 14 13:36:27.350438 master-0 kubenswrapper[4807]: E1014 13:36:27.350351 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"dnsmasq-dns\" with CreateContainerError: \"container create failed: mount `/var/lib/kubelet/pods/3302de2a-14e6-4970-a3b3-88304db4238d/volume-subpaths/dns-svc/dnsmasq-dns/1` to `etc/dnsmasq.d/hosts/dns-svc`: No such file or directory\\n\"" pod="openstack/dnsmasq-dns-76965fd747-snwh6" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" Oct 14 13:36:27.874254 master-0 kubenswrapper[4807]: I1014 13:36:27.873870 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:29.183651 master-0 kubenswrapper[4807]: I1014 13:36:29.183583 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-76965fd747-snwh6" event={"ID":"3302de2a-14e6-4970-a3b3-88304db4238d","Type":"ContainerStarted","Data":"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8"} Oct 14 13:36:29.185134 master-0 kubenswrapper[4807]: I1014 13:36:29.185114 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:29.185247 master-0 kubenswrapper[4807]: I1014 13:36:29.183910 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-76965fd747-snwh6" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="dnsmasq-dns" containerID="cri-o://a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8" gracePeriod=10 Oct 14 13:36:29.414137 master-0 kubenswrapper[4807]: I1014 13:36:29.410637 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-76965fd747-snwh6" podStartSLOduration=5.410602534 podStartE2EDuration="5.410602534s" podCreationTimestamp="2025-10-14 13:36:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:36:29.313852297 +0000 UTC m=+983.995154121" watchObservedRunningTime="2025-10-14 13:36:29.410602534 +0000 UTC m=+984.091904378" Oct 14 13:36:29.715292 master-0 kubenswrapper[4807]: I1014 13:36:29.715228 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:29.767732 master-0 kubenswrapper[4807]: I1014 13:36:29.767654 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.768088 master-0 kubenswrapper[4807]: I1014 13:36:29.767774 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.768088 master-0 kubenswrapper[4807]: I1014 13:36:29.767840 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.768088 master-0 kubenswrapper[4807]: I1014 13:36:29.767908 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.768088 master-0 kubenswrapper[4807]: I1014 13:36:29.767946 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.768088 master-0 kubenswrapper[4807]: I1014 13:36:29.768013 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djvdv\" (UniqueName: \"kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv\") pod \"3302de2a-14e6-4970-a3b3-88304db4238d\" (UID: \"3302de2a-14e6-4970-a3b3-88304db4238d\") " Oct 14 13:36:29.772662 master-0 kubenswrapper[4807]: I1014 13:36:29.772565 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv" (OuterVolumeSpecName: "kube-api-access-djvdv") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "kube-api-access-djvdv". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:36:29.803310 master-0 kubenswrapper[4807]: I1014 13:36:29.803186 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:29.810035 master-0 kubenswrapper[4807]: I1014 13:36:29.809949 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config" (OuterVolumeSpecName: "config") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:29.820677 master-0 kubenswrapper[4807]: I1014 13:36:29.820568 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:29.824282 master-0 kubenswrapper[4807]: I1014 13:36:29.824193 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:29.826673 master-0 kubenswrapper[4807]: I1014 13:36:29.826606 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "3302de2a-14e6-4970-a3b3-88304db4238d" (UID: "3302de2a-14e6-4970-a3b3-88304db4238d"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870485 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-djvdv\" (UniqueName: \"kubernetes.io/projected/3302de2a-14e6-4970-a3b3-88304db4238d-kube-api-access-djvdv\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870541 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870555 4807 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870574 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870583 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:29.870566 master-0 kubenswrapper[4807]: I1014 13:36:29.870592 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/3302de2a-14e6-4970-a3b3-88304db4238d-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:30.197027 master-0 kubenswrapper[4807]: I1014 13:36:30.196936 4807 generic.go:334] "Generic (PLEG): container finished" podID="3302de2a-14e6-4970-a3b3-88304db4238d" containerID="a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8" exitCode=0 Oct 14 13:36:30.197027 master-0 kubenswrapper[4807]: I1014 13:36:30.197010 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-76965fd747-snwh6" event={"ID":"3302de2a-14e6-4970-a3b3-88304db4238d","Type":"ContainerDied","Data":"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8"} Oct 14 13:36:30.198146 master-0 kubenswrapper[4807]: I1014 13:36:30.197051 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-76965fd747-snwh6" event={"ID":"3302de2a-14e6-4970-a3b3-88304db4238d","Type":"ContainerDied","Data":"f9b576acbb4b316f2b974de5c3a34951673cf0ff196e8fd98973c675fcbbffac"} Oct 14 13:36:30.198146 master-0 kubenswrapper[4807]: I1014 13:36:30.197075 4807 scope.go:117] "RemoveContainer" containerID="a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8" Oct 14 13:36:30.198146 master-0 kubenswrapper[4807]: I1014 13:36:30.197308 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-76965fd747-snwh6" Oct 14 13:36:30.229039 master-0 kubenswrapper[4807]: I1014 13:36:30.228957 4807 scope.go:117] "RemoveContainer" containerID="9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420" Oct 14 13:36:30.249907 master-0 kubenswrapper[4807]: I1014 13:36:30.249848 4807 scope.go:117] "RemoveContainer" containerID="a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8" Oct 14 13:36:30.250596 master-0 kubenswrapper[4807]: E1014 13:36:30.250525 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8\": container with ID starting with a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8 not found: ID does not exist" containerID="a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8" Oct 14 13:36:30.250751 master-0 kubenswrapper[4807]: I1014 13:36:30.250603 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8"} err="failed to get container status \"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8\": rpc error: code = NotFound desc = could not find container \"a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8\": container with ID starting with a4d9d4e1390f4d21d43f3b9d72c49391db17064f9848e885b646214b75355af8 not found: ID does not exist" Oct 14 13:36:30.250751 master-0 kubenswrapper[4807]: I1014 13:36:30.250652 4807 scope.go:117] "RemoveContainer" containerID="9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420" Oct 14 13:36:30.251313 master-0 kubenswrapper[4807]: E1014 13:36:30.251262 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420\": container with ID starting with 9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420 not found: ID does not exist" containerID="9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420" Oct 14 13:36:30.251428 master-0 kubenswrapper[4807]: I1014 13:36:30.251344 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420"} err="failed to get container status \"9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420\": rpc error: code = NotFound desc = could not find container \"9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420\": container with ID starting with 9948ecd4a36b2ce9dc647c5d610a28065bfa3020773dd5f4f32d15472bc42420 not found: ID does not exist" Oct 14 13:36:31.177992 master-0 kubenswrapper[4807]: I1014 13:36:31.177887 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:31.356484 master-0 kubenswrapper[4807]: I1014 13:36:31.355671 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-76965fd747-snwh6"] Oct 14 13:36:31.408663 master-0 kubenswrapper[4807]: I1014 13:36:31.407408 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:36:32.221876 master-0 kubenswrapper[4807]: I1014 13:36:32.221400 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerStarted","Data":"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c"} Oct 14 13:36:32.221876 master-0 kubenswrapper[4807]: I1014 13:36:32.221455 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerStarted","Data":"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd"} Oct 14 13:36:32.221876 master-0 kubenswrapper[4807]: I1014 13:36:32.221482 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerStarted","Data":"37ad9f0b0949050f2b28ab3249121c88d0bc5485616772355da42c2ef85553e0"} Oct 14 13:36:32.222514 master-0 kubenswrapper[4807]: I1014 13:36:32.222418 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:32.273840 master-0 kubenswrapper[4807]: I1014 13:36:32.273778 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" path="/var/lib/kubelet/pods/3302de2a-14e6-4970-a3b3-88304db4238d/volumes" Oct 14 13:36:34.328056 master-0 kubenswrapper[4807]: I1014 13:36:34.324589 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-55c4fcb4cb-sszff" podStartSLOduration=8.324559023 podStartE2EDuration="8.324559023s" podCreationTimestamp="2025-10-14 13:36:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:36:34.037420939 +0000 UTC m=+988.718722763" watchObservedRunningTime="2025-10-14 13:36:34.324559023 +0000 UTC m=+989.005860887" Oct 14 13:36:35.039178 master-0 kubenswrapper[4807]: I1014 13:36:35.039043 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:36:35.040269 master-0 kubenswrapper[4807]: E1014 13:36:35.040244 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="dnsmasq-dns" Oct 14 13:36:35.040435 master-0 kubenswrapper[4807]: I1014 13:36:35.040416 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="dnsmasq-dns" Oct 14 13:36:35.040584 master-0 kubenswrapper[4807]: E1014 13:36:35.040567 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="init" Oct 14 13:36:35.040682 master-0 kubenswrapper[4807]: I1014 13:36:35.040664 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="init" Oct 14 13:36:35.041096 master-0 kubenswrapper[4807]: I1014 13:36:35.041070 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="3302de2a-14e6-4970-a3b3-88304db4238d" containerName="dnsmasq-dns" Oct 14 13:36:35.043160 master-0 kubenswrapper[4807]: I1014 13:36:35.043129 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.048380 master-0 kubenswrapper[4807]: I1014 13:36:35.047778 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-scripts" Oct 14 13:36:35.048380 master-0 kubenswrapper[4807]: I1014 13:36:35.048259 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-46645-default-external-config-data" Oct 14 13:36:35.105938 master-0 kubenswrapper[4807]: I1014 13:36:35.105807 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:36:35.180905 master-0 kubenswrapper[4807]: I1014 13:36:35.179752 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pkwb\" (UniqueName: \"kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.181659 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.182018 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.182146 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.182211 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.182269 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.184668 master-0 kubenswrapper[4807]: I1014 13:36:35.182368 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.266210 master-0 kubenswrapper[4807]: I1014 13:36:35.266136 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:36:35.267546 master-0 kubenswrapper[4807]: I1014 13:36:35.267517 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.273620 master-0 kubenswrapper[4807]: I1014 13:36:35.273328 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-scripts" Oct 14 13:36:35.273620 master-0 kubenswrapper[4807]: I1014 13:36:35.273474 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-volume-lvm-iscsi-config-data" Oct 14 13:36:35.274109 master-0 kubenswrapper[4807]: I1014 13:36:35.273812 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-config-data" Oct 14 13:36:35.285089 master-0 kubenswrapper[4807]: I1014 13:36:35.285034 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.285552 master-0 kubenswrapper[4807]: I1014 13:36:35.285533 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.285792 master-0 kubenswrapper[4807]: I1014 13:36:35.285741 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.285906 master-0 kubenswrapper[4807]: I1014 13:36:35.285889 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.286004 master-0 kubenswrapper[4807]: I1014 13:36:35.285990 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.286115 master-0 kubenswrapper[4807]: I1014 13:36:35.286069 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.286173 master-0 kubenswrapper[4807]: I1014 13:36:35.286100 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.286651 master-0 kubenswrapper[4807]: I1014 13:36:35.286631 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2pkwb\" (UniqueName: \"kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.286767 master-0 kubenswrapper[4807]: I1014 13:36:35.286749 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.290036 master-0 kubenswrapper[4807]: I1014 13:36:35.289660 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:36:35.290036 master-0 kubenswrapper[4807]: I1014 13:36:35.289692 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0946533a7a577b6cc932fda485e2d60110dea942f3391c26e217691a26212479/globalmount\"" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.291945 master-0 kubenswrapper[4807]: I1014 13:36:35.291904 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.306080 master-0 kubenswrapper[4807]: I1014 13:36:35.306007 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.307262 master-0 kubenswrapper[4807]: I1014 13:36:35.307216 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:36:35.313186 master-0 kubenswrapper[4807]: I1014 13:36:35.313067 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.376642 master-0 kubenswrapper[4807]: I1014 13:36:35.376575 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pkwb\" (UniqueName: \"kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:35.389372 master-0 kubenswrapper[4807]: I1014 13:36:35.389306 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-697ps\" (UniqueName: \"kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389524 master-0 kubenswrapper[4807]: I1014 13:36:35.389375 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389524 master-0 kubenswrapper[4807]: I1014 13:36:35.389424 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389599 master-0 kubenswrapper[4807]: I1014 13:36:35.389558 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389599 master-0 kubenswrapper[4807]: I1014 13:36:35.389584 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389659 master-0 kubenswrapper[4807]: I1014 13:36:35.389612 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389659 master-0 kubenswrapper[4807]: I1014 13:36:35.389648 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389730 master-0 kubenswrapper[4807]: I1014 13:36:35.389666 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389730 master-0 kubenswrapper[4807]: I1014 13:36:35.389688 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389730 master-0 kubenswrapper[4807]: I1014 13:36:35.389714 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389891 master-0 kubenswrapper[4807]: I1014 13:36:35.389734 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389891 master-0 kubenswrapper[4807]: I1014 13:36:35.389760 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389891 master-0 kubenswrapper[4807]: I1014 13:36:35.389786 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389891 master-0 kubenswrapper[4807]: I1014 13:36:35.389812 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.389891 master-0 kubenswrapper[4807]: I1014 13:36:35.389843 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490408 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490521 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-697ps\" (UniqueName: \"kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490557 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490592 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490626 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490651 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490680 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490722 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490747 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490775 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490805 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490829 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490854 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490889 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.490915 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.491023 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.491281 master-0 kubenswrapper[4807]: I1014 13:36:35.491076 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.492673 master-0 kubenswrapper[4807]: I1014 13:36:35.492592 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.492848 master-0 kubenswrapper[4807]: I1014 13:36:35.492822 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.492921 master-0 kubenswrapper[4807]: I1014 13:36:35.492864 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.492992 master-0 kubenswrapper[4807]: I1014 13:36:35.492831 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.494277 master-0 kubenswrapper[4807]: I1014 13:36:35.494213 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.494391 master-0 kubenswrapper[4807]: I1014 13:36:35.494370 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.494437 master-0 kubenswrapper[4807]: I1014 13:36:35.494408 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.494499 master-0 kubenswrapper[4807]: I1014 13:36:35.494441 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.497438 master-0 kubenswrapper[4807]: I1014 13:36:35.497390 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.497643 master-0 kubenswrapper[4807]: I1014 13:36:35.497598 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.498310 master-0 kubenswrapper[4807]: I1014 13:36:35.498252 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.498917 master-0 kubenswrapper[4807]: I1014 13:36:35.498899 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.514224 master-0 kubenswrapper[4807]: I1014 13:36:35.514155 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-697ps\" (UniqueName: \"kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.600403 master-0 kubenswrapper[4807]: I1014 13:36:35.600326 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:36:35.813667 master-0 kubenswrapper[4807]: I1014 13:36:35.812529 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:35.816726 master-0 kubenswrapper[4807]: I1014 13:36:35.815060 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:35.819352 master-0 kubenswrapper[4807]: I1014 13:36:35.818217 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:36:35.819352 master-0 kubenswrapper[4807]: I1014 13:36:35.818541 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:36:35.819352 master-0 kubenswrapper[4807]: I1014 13:36:35.818711 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:36:35.819352 master-0 kubenswrapper[4807]: I1014 13:36:35.818955 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:36:35.819352 master-0 kubenswrapper[4807]: I1014 13:36:35.819125 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Oct 14 13:36:35.823213 master-0 kubenswrapper[4807]: I1014 13:36:35.823151 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:36.006754 master-0 kubenswrapper[4807]: I1014 13:36:36.006690 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kz54\" (UniqueName: \"kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.006754 master-0 kubenswrapper[4807]: I1014 13:36:36.006755 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.007047 master-0 kubenswrapper[4807]: I1014 13:36:36.006855 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.007047 master-0 kubenswrapper[4807]: I1014 13:36:36.006953 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.007106 master-0 kubenswrapper[4807]: I1014 13:36:36.007068 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.007140 master-0 kubenswrapper[4807]: I1014 13:36:36.007118 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.086335 master-0 kubenswrapper[4807]: I1014 13:36:36.084166 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:36:36.086335 master-0 kubenswrapper[4807]: I1014 13:36:36.085830 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.088427 master-0 kubenswrapper[4807]: I1014 13:36:36.088373 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-api-config-data" Oct 14 13:36:36.107558 master-0 kubenswrapper[4807]: I1014 13:36:36.107492 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:36:36.109044 master-0 kubenswrapper[4807]: I1014 13:36:36.109005 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.109118 master-0 kubenswrapper[4807]: I1014 13:36:36.109075 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.109155 master-0 kubenswrapper[4807]: I1014 13:36:36.109119 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-5kz54\" (UniqueName: \"kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.109192 master-0 kubenswrapper[4807]: I1014 13:36:36.109155 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.109192 master-0 kubenswrapper[4807]: I1014 13:36:36.109188 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.109258 master-0 kubenswrapper[4807]: I1014 13:36:36.109215 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.110813 master-0 kubenswrapper[4807]: I1014 13:36:36.110520 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.111414 master-0 kubenswrapper[4807]: I1014 13:36:36.111385 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.112380 master-0 kubenswrapper[4807]: I1014 13:36:36.111924 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.112380 master-0 kubenswrapper[4807]: I1014 13:36:36.112047 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.112531 master-0 kubenswrapper[4807]: I1014 13:36:36.112391 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.140586 master-0 kubenswrapper[4807]: I1014 13:36:36.140488 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:36:36.155269 master-0 kubenswrapper[4807]: W1014 13:36:36.155207 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e4d4896_9b3d_4104_8c4a_0d85698d7850.slice/crio-c14766eef29f75b4fcc64fc252a81041a6fc3960f7848c67c87a1005e6c6ba1f WatchSource:0}: Error finding container c14766eef29f75b4fcc64fc252a81041a6fc3960f7848c67c87a1005e6c6ba1f: Status 404 returned error can't find the container with id c14766eef29f75b4fcc64fc252a81041a6fc3960f7848c67c87a1005e6c6ba1f Oct 14 13:36:36.167248 master-0 kubenswrapper[4807]: I1014 13:36:36.167199 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kz54\" (UniqueName: \"kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54\") pod \"dnsmasq-dns-8567478bc9-v62gl\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.211657 master-0 kubenswrapper[4807]: I1014 13:36:36.211585 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.211942 master-0 kubenswrapper[4807]: I1014 13:36:36.211898 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.212810 master-0 kubenswrapper[4807]: I1014 13:36:36.211989 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c4w9\" (UniqueName: \"kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.212810 master-0 kubenswrapper[4807]: I1014 13:36:36.212214 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.212810 master-0 kubenswrapper[4807]: I1014 13:36:36.212379 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.212810 master-0 kubenswrapper[4807]: I1014 13:36:36.212413 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.212810 master-0 kubenswrapper[4807]: I1014 13:36:36.212638 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.283006 master-0 kubenswrapper[4807]: I1014 13:36:36.282912 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerStarted","Data":"c14766eef29f75b4fcc64fc252a81041a6fc3960f7848c67c87a1005e6c6ba1f"} Oct 14 13:36:36.314281 master-0 kubenswrapper[4807]: I1014 13:36:36.314190 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-2c4w9\" (UniqueName: \"kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314281 master-0 kubenswrapper[4807]: I1014 13:36:36.314294 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314661 master-0 kubenswrapper[4807]: I1014 13:36:36.314331 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314661 master-0 kubenswrapper[4807]: I1014 13:36:36.314352 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314661 master-0 kubenswrapper[4807]: I1014 13:36:36.314395 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314661 master-0 kubenswrapper[4807]: I1014 13:36:36.314439 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.314661 master-0 kubenswrapper[4807]: I1014 13:36:36.314508 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.315513 master-0 kubenswrapper[4807]: I1014 13:36:36.315417 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.315870 master-0 kubenswrapper[4807]: I1014 13:36:36.315822 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.317734 master-0 kubenswrapper[4807]: I1014 13:36:36.317698 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.318239 master-0 kubenswrapper[4807]: I1014 13:36:36.318205 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.319488 master-0 kubenswrapper[4807]: I1014 13:36:36.319320 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.323690 master-0 kubenswrapper[4807]: I1014 13:36:36.321784 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.347527 master-0 kubenswrapper[4807]: I1014 13:36:36.347351 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c4w9\" (UniqueName: \"kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9\") pod \"cinder-46645-api-1\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.444304 master-0 kubenswrapper[4807]: I1014 13:36:36.444212 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:36.444304 master-0 kubenswrapper[4807]: I1014 13:36:36.444280 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:36:36.796536 master-0 kubenswrapper[4807]: I1014 13:36:36.796175 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:36.846591 master-0 kubenswrapper[4807]: I1014 13:36:36.846498 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:36.871094 master-0 kubenswrapper[4807]: I1014 13:36:36.870960 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:36:36.963424 master-0 kubenswrapper[4807]: W1014 13:36:36.957882 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd69f7a9b_082d_4473_a2fe_9c634b1f3adc.slice/crio-90ef075e576b1763cb992c6527d50392d4958dcc338d747a7495d03ef60b07e0 WatchSource:0}: Error finding container 90ef075e576b1763cb992c6527d50392d4958dcc338d747a7495d03ef60b07e0: Status 404 returned error can't find the container with id 90ef075e576b1763cb992c6527d50392d4958dcc338d747a7495d03ef60b07e0 Oct 14 13:36:36.968078 master-0 kubenswrapper[4807]: I1014 13:36:36.968012 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:37.271276 master-0 kubenswrapper[4807]: I1014 13:36:37.271196 4807 generic.go:334] "Generic (PLEG): container finished" podID="d69f7a9b-082d-4473-a2fe-9c634b1f3adc" containerID="8c1303a2db5f353ae26a319c62093cb99de6b476597cb3d01b9f591320436672" exitCode=0 Oct 14 13:36:37.271276 master-0 kubenswrapper[4807]: I1014 13:36:37.271243 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" event={"ID":"d69f7a9b-082d-4473-a2fe-9c634b1f3adc","Type":"ContainerDied","Data":"8c1303a2db5f353ae26a319c62093cb99de6b476597cb3d01b9f591320436672"} Oct 14 13:36:37.271276 master-0 kubenswrapper[4807]: I1014 13:36:37.271272 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" event={"ID":"d69f7a9b-082d-4473-a2fe-9c634b1f3adc","Type":"ContainerStarted","Data":"90ef075e576b1763cb992c6527d50392d4958dcc338d747a7495d03ef60b07e0"} Oct 14 13:36:37.356380 master-0 kubenswrapper[4807]: I1014 13:36:37.355220 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:36:37.517628 master-0 kubenswrapper[4807]: I1014 13:36:37.512907 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:36:37.703548 master-0 kubenswrapper[4807]: I1014 13:36:37.703447 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:37.799760 master-0 kubenswrapper[4807]: I1014 13:36:37.799524 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:36:37.849273 master-0 kubenswrapper[4807]: I1014 13:36:37.849218 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.849273 master-0 kubenswrapper[4807]: I1014 13:36:37.849275 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.849650 master-0 kubenswrapper[4807]: I1014 13:36:37.849355 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.849650 master-0 kubenswrapper[4807]: I1014 13:36:37.849407 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.849650 master-0 kubenswrapper[4807]: I1014 13:36:37.849523 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.849777 master-0 kubenswrapper[4807]: I1014 13:36:37.849650 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kz54\" (UniqueName: \"kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54\") pod \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\" (UID: \"d69f7a9b-082d-4473-a2fe-9c634b1f3adc\") " Oct 14 13:36:37.854027 master-0 kubenswrapper[4807]: I1014 13:36:37.853971 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54" (OuterVolumeSpecName: "kube-api-access-5kz54") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "kube-api-access-5kz54". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:36:37.866270 master-0 kubenswrapper[4807]: I1014 13:36:37.866181 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:37.879551 master-0 kubenswrapper[4807]: I1014 13:36:37.879479 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:37.880053 master-0 kubenswrapper[4807]: I1014 13:36:37.879976 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config" (OuterVolumeSpecName: "config") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:37.880683 master-0 kubenswrapper[4807]: I1014 13:36:37.880654 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:37.881740 master-0 kubenswrapper[4807]: I1014 13:36:37.881694 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "d69f7a9b-082d-4473-a2fe-9c634b1f3adc" (UID: "d69f7a9b-082d-4473-a2fe-9c634b1f3adc"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:36:37.953403 master-0 kubenswrapper[4807]: I1014 13:36:37.953333 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-5kz54\" (UniqueName: \"kubernetes.io/projected/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-kube-api-access-5kz54\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:37.953403 master-0 kubenswrapper[4807]: I1014 13:36:37.953387 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:37.953403 master-0 kubenswrapper[4807]: I1014 13:36:37.953401 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:37.953403 master-0 kubenswrapper[4807]: I1014 13:36:37.953411 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:37.953403 master-0 kubenswrapper[4807]: I1014 13:36:37.953420 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:37.953824 master-0 kubenswrapper[4807]: I1014 13:36:37.953431 4807 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/d69f7a9b-082d-4473-a2fe-9c634b1f3adc-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Oct 14 13:36:38.285006 master-0 kubenswrapper[4807]: I1014 13:36:38.284923 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" event={"ID":"d69f7a9b-082d-4473-a2fe-9c634b1f3adc","Type":"ContainerDied","Data":"90ef075e576b1763cb992c6527d50392d4958dcc338d747a7495d03ef60b07e0"} Oct 14 13:36:38.285006 master-0 kubenswrapper[4807]: I1014 13:36:38.284992 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-8567478bc9-v62gl" Oct 14 13:36:38.285424 master-0 kubenswrapper[4807]: I1014 13:36:38.285038 4807 scope.go:117] "RemoveContainer" containerID="8c1303a2db5f353ae26a319c62093cb99de6b476597cb3d01b9f591320436672" Oct 14 13:36:38.297653 master-0 kubenswrapper[4807]: I1014 13:36:38.297606 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerStarted","Data":"0261672d53de1489335a4101d8ce3fdda5adc5a1a218163c803b3fa9e4993bb9"} Oct 14 13:36:38.320925 master-0 kubenswrapper[4807]: I1014 13:36:38.320856 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerStarted","Data":"dc53605e5c3eff6df9efd76caa0d89493f9ef298861ac7db0adba7bcb6e9434f"} Oct 14 13:36:38.449038 master-0 kubenswrapper[4807]: I1014 13:36:38.448974 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:38.460722 master-0 kubenswrapper[4807]: I1014 13:36:38.460657 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-8567478bc9-v62gl"] Oct 14 13:36:39.049159 master-0 kubenswrapper[4807]: I1014 13:36:39.049026 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:36:39.049782 master-0 kubenswrapper[4807]: E1014 13:36:39.049618 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d69f7a9b-082d-4473-a2fe-9c634b1f3adc" containerName="init" Oct 14 13:36:39.049782 master-0 kubenswrapper[4807]: I1014 13:36:39.049676 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="d69f7a9b-082d-4473-a2fe-9c634b1f3adc" containerName="init" Oct 14 13:36:39.049882 master-0 kubenswrapper[4807]: I1014 13:36:39.049811 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="d69f7a9b-082d-4473-a2fe-9c634b1f3adc" containerName="init" Oct 14 13:36:39.050849 master-0 kubenswrapper[4807]: I1014 13:36:39.050825 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.054779 master-0 kubenswrapper[4807]: I1014 13:36:39.054179 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Oct 14 13:36:39.055040 master-0 kubenswrapper[4807]: I1014 13:36:39.054837 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-46645-default-internal-config-data" Oct 14 13:36:39.075895 master-0 kubenswrapper[4807]: I1014 13:36:39.075791 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:36:39.177307 master-0 kubenswrapper[4807]: I1014 13:36:39.177249 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177307 master-0 kubenswrapper[4807]: I1014 13:36:39.177311 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177592 master-0 kubenswrapper[4807]: I1014 13:36:39.177361 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177592 master-0 kubenswrapper[4807]: I1014 13:36:39.177431 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177592 master-0 kubenswrapper[4807]: I1014 13:36:39.177455 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtmnv\" (UniqueName: \"kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177592 master-0 kubenswrapper[4807]: I1014 13:36:39.177498 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177748 master-0 kubenswrapper[4807]: I1014 13:36:39.177676 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.177949 master-0 kubenswrapper[4807]: I1014 13:36:39.177908 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281127 master-0 kubenswrapper[4807]: I1014 13:36:39.280994 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rtmnv\" (UniqueName: \"kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281127 master-0 kubenswrapper[4807]: I1014 13:36:39.281055 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281127 master-0 kubenswrapper[4807]: I1014 13:36:39.281106 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281127 master-0 kubenswrapper[4807]: I1014 13:36:39.281149 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281673 master-0 kubenswrapper[4807]: I1014 13:36:39.281216 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281673 master-0 kubenswrapper[4807]: I1014 13:36:39.281240 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281673 master-0 kubenswrapper[4807]: I1014 13:36:39.281277 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.281673 master-0 kubenswrapper[4807]: I1014 13:36:39.281306 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.282824 master-0 kubenswrapper[4807]: I1014 13:36:39.281827 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.283184 master-0 kubenswrapper[4807]: I1014 13:36:39.283116 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.284957 master-0 kubenswrapper[4807]: I1014 13:36:39.284917 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:36:39.285018 master-0 kubenswrapper[4807]: I1014 13:36:39.284964 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0607fd0fd3d9e9ca937336483b9a0d8b1a65cee7b1ad65dcc6c16eec0f2d3d73/globalmount\"" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.287897 master-0 kubenswrapper[4807]: I1014 13:36:39.287566 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.287897 master-0 kubenswrapper[4807]: I1014 13:36:39.287815 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.288186 master-0 kubenswrapper[4807]: I1014 13:36:39.288160 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.288434 master-0 kubenswrapper[4807]: I1014 13:36:39.288408 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:39.302525 master-0 kubenswrapper[4807]: I1014 13:36:39.302395 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtmnv\" (UniqueName: \"kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:40.282990 master-0 kubenswrapper[4807]: I1014 13:36:40.282806 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d69f7a9b-082d-4473-a2fe-9c634b1f3adc" path="/var/lib/kubelet/pods/d69f7a9b-082d-4473-a2fe-9c634b1f3adc/volumes" Oct 14 13:36:40.670742 master-0 kubenswrapper[4807]: I1014 13:36:40.670617 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:40.905485 master-0 kubenswrapper[4807]: I1014 13:36:40.902289 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:36:41.648549 master-0 kubenswrapper[4807]: I1014 13:36:41.648445 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:36:41.656566 master-0 kubenswrapper[4807]: W1014 13:36:41.656014 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod16c0ea67_fb7f_4e96_9cc5_4da186d26c08.slice/crio-b3639be31d3de0ef723506b67d6e9bc3590a5e23de3564175d3c2794d8774259 WatchSource:0}: Error finding container b3639be31d3de0ef723506b67d6e9bc3590a5e23de3564175d3c2794d8774259: Status 404 returned error can't find the container with id b3639be31d3de0ef723506b67d6e9bc3590a5e23de3564175d3c2794d8774259 Oct 14 13:36:42.391370 master-0 kubenswrapper[4807]: I1014 13:36:42.391301 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerStarted","Data":"b3639be31d3de0ef723506b67d6e9bc3590a5e23de3564175d3c2794d8774259"} Oct 14 13:36:45.731535 master-0 kubenswrapper[4807]: I1014 13:36:45.731226 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/ironic-66b7ffc58b-797f7"] Oct 14 13:36:45.733838 master-0 kubenswrapper[4807]: I1014 13:36:45.733740 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.736775 master-0 kubenswrapper[4807]: I1014 13:36:45.736729 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-scripts" Oct 14 13:36:45.736775 master-0 kubenswrapper[4807]: I1014 13:36:45.736769 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-api-config-data" Oct 14 13:36:45.736870 master-0 kubenswrapper[4807]: I1014 13:36:45.736834 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-transport" Oct 14 13:36:45.737328 master-0 kubenswrapper[4807]: I1014 13:36:45.737288 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-public-svc" Oct 14 13:36:45.738153 master-0 kubenswrapper[4807]: I1014 13:36:45.738120 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"ironic-config-data" Oct 14 13:36:45.738359 master-0 kubenswrapper[4807]: I1014 13:36:45.738329 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-ironic-internal-svc" Oct 14 13:36:45.761279 master-0 kubenswrapper[4807]: I1014 13:36:45.761190 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-66b7ffc58b-797f7"] Oct 14 13:36:45.780268 master-0 kubenswrapper[4807]: I1014 13:36:45.780202 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-custom\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780599 master-0 kubenswrapper[4807]: I1014 13:36:45.780312 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-merged\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780599 master-0 kubenswrapper[4807]: I1014 13:36:45.780421 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-scripts\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780599 master-0 kubenswrapper[4807]: I1014 13:36:45.780495 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-internal-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780599 master-0 kubenswrapper[4807]: I1014 13:36:45.780524 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-combined-ca-bundle\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780731 master-0 kubenswrapper[4807]: I1014 13:36:45.780603 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-logs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780829 master-0 kubenswrapper[4807]: I1014 13:36:45.780792 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1784e65-d184-40d4-b81e-2203c0fa2007-etc-podinfo\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.780988 master-0 kubenswrapper[4807]: I1014 13:36:45.780964 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rx5zw\" (UniqueName: \"kubernetes.io/projected/b1784e65-d184-40d4-b81e-2203c0fa2007-kube-api-access-rx5zw\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.781070 master-0 kubenswrapper[4807]: I1014 13:36:45.781048 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.781112 master-0 kubenswrapper[4807]: I1014 13:36:45.781072 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-public-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.883739 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rx5zw\" (UniqueName: \"kubernetes.io/projected/b1784e65-d184-40d4-b81e-2203c0fa2007-kube-api-access-rx5zw\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.883830 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.883866 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-public-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.883941 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-custom\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.883989 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-merged\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.884020 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-internal-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.884049 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-scripts\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.884079 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-combined-ca-bundle\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.884119 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-logs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.884177 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1784e65-d184-40d4-b81e-2203c0fa2007-etc-podinfo\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.885451 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-logs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.885814 master-0 kubenswrapper[4807]: I1014 13:36:45.885791 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-merged\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.892533 master-0 kubenswrapper[4807]: I1014 13:36:45.890978 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.894197 master-0 kubenswrapper[4807]: I1014 13:36:45.893016 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b1784e65-d184-40d4-b81e-2203c0fa2007-etc-podinfo\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.894197 master-0 kubenswrapper[4807]: I1014 13:36:45.893056 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-scripts\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.894197 master-0 kubenswrapper[4807]: I1014 13:36:45.893197 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-config-data-custom\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.894197 master-0 kubenswrapper[4807]: I1014 13:36:45.893383 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-combined-ca-bundle\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.896944 master-0 kubenswrapper[4807]: I1014 13:36:45.896915 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-public-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.902861 master-0 kubenswrapper[4807]: I1014 13:36:45.902797 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/b1784e65-d184-40d4-b81e-2203c0fa2007-internal-tls-certs\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:45.906566 master-0 kubenswrapper[4807]: I1014 13:36:45.906528 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rx5zw\" (UniqueName: \"kubernetes.io/projected/b1784e65-d184-40d4-b81e-2203c0fa2007-kube-api-access-rx5zw\") pod \"ironic-66b7ffc58b-797f7\" (UID: \"b1784e65-d184-40d4-b81e-2203c0fa2007\") " pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:46.064362 master-0 kubenswrapper[4807]: I1014 13:36:46.064204 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:36:47.508172 master-0 kubenswrapper[4807]: I1014 13:36:47.508093 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/keystone-5755976884-dmt6m" Oct 14 13:36:48.534483 master-0 kubenswrapper[4807]: I1014 13:36:48.534389 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:36:48.535936 master-0 kubenswrapper[4807]: I1014 13:36:48.535904 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.542883 master-0 kubenswrapper[4807]: I1014 13:36:48.538431 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:36:48.542883 master-0 kubenswrapper[4807]: I1014 13:36:48.538718 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:36:48.542883 master-0 kubenswrapper[4807]: I1014 13:36:48.539059 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:36:48.542883 master-0 kubenswrapper[4807]: I1014 13:36:48.539087 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Oct 14 13:36:48.542883 master-0 kubenswrapper[4807]: I1014 13:36:48.539245 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:36:48.642579 master-0 kubenswrapper[4807]: I1014 13:36:48.642313 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:36:48.649295 master-0 kubenswrapper[4807]: I1014 13:36:48.649242 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.649422 master-0 kubenswrapper[4807]: I1014 13:36:48.649307 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.649632 master-0 kubenswrapper[4807]: I1014 13:36:48.649595 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.649692 master-0 kubenswrapper[4807]: I1014 13:36:48.649664 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.649752 master-0 kubenswrapper[4807]: I1014 13:36:48.649712 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2g4v\" (UniqueName: \"kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.650126 master-0 kubenswrapper[4807]: I1014 13:36:48.650085 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759102 master-0 kubenswrapper[4807]: I1014 13:36:48.759025 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759102 master-0 kubenswrapper[4807]: I1014 13:36:48.759100 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759483 master-0 kubenswrapper[4807]: I1014 13:36:48.759162 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759483 master-0 kubenswrapper[4807]: I1014 13:36:48.759189 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759483 master-0 kubenswrapper[4807]: I1014 13:36:48.759225 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-j2g4v\" (UniqueName: \"kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.759483 master-0 kubenswrapper[4807]: I1014 13:36:48.759324 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.760886 master-0 kubenswrapper[4807]: I1014 13:36:48.760842 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.760949 master-0 kubenswrapper[4807]: I1014 13:36:48.760895 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.761690 master-0 kubenswrapper[4807]: I1014 13:36:48.761662 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.762135 master-0 kubenswrapper[4807]: I1014 13:36:48.762085 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.762399 master-0 kubenswrapper[4807]: I1014 13:36:48.762155 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.795691 master-0 kubenswrapper[4807]: I1014 13:36:48.789233 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2g4v\" (UniqueName: \"kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v\") pod \"dnsmasq-dns-798b8945b9-2b8d8\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:48.856118 master-0 kubenswrapper[4807]: I1014 13:36:48.856038 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:36:51.756402 master-0 kubenswrapper[4807]: I1014 13:36:51.756292 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:52.016019 master-0 kubenswrapper[4807]: I1014 13:36:52.015799 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/placement-958c54db4-xtfr6" Oct 14 13:36:56.929836 master-0 kubenswrapper[4807]: I1014 13:36:56.929772 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:36:58.237835 master-0 kubenswrapper[4807]: I1014 13:36:58.235589 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:36:58.238588 master-0 kubenswrapper[4807]: I1014 13:36:58.238286 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.244095 master-0 kubenswrapper[4807]: I1014 13:36:58.243403 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"heat-config-data" Oct 14 13:36:58.244095 master-0 kubenswrapper[4807]: I1014 13:36:58.243647 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"heat-api-config-data" Oct 14 13:36:58.257405 master-0 kubenswrapper[4807]: I1014 13:36:58.257320 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:36:58.286591 master-0 kubenswrapper[4807]: I1014 13:36:58.286516 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.286907 master-0 kubenswrapper[4807]: I1014 13:36:58.286625 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5pvt\" (UniqueName: \"kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.287207 master-0 kubenswrapper[4807]: I1014 13:36:58.287106 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.287288 master-0 kubenswrapper[4807]: I1014 13:36:58.287243 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.297200 master-0 kubenswrapper[4807]: I1014 13:36:58.297132 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:36:58.388486 master-0 kubenswrapper[4807]: I1014 13:36:58.388396 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-h5pvt\" (UniqueName: \"kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.388714 master-0 kubenswrapper[4807]: I1014 13:36:58.388520 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.388714 master-0 kubenswrapper[4807]: I1014 13:36:58.388565 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.388714 master-0 kubenswrapper[4807]: I1014 13:36:58.388643 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.392922 master-0 kubenswrapper[4807]: I1014 13:36:58.392827 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.393948 master-0 kubenswrapper[4807]: I1014 13:36:58.393896 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.396274 master-0 kubenswrapper[4807]: I1014 13:36:58.396227 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.435007 master-0 kubenswrapper[4807]: I1014 13:36:58.434931 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:36:58.463072 master-0 kubenswrapper[4807]: I1014 13:36:58.462668 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5pvt\" (UniqueName: \"kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt\") pod \"heat-api-6875d55546-w7958\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:36:58.574089 master-0 kubenswrapper[4807]: I1014 13:36:58.573847 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:37:02.033137 master-0 kubenswrapper[4807]: I1014 13:37:02.033054 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:37:02.070958 master-0 kubenswrapper[4807]: W1014 13:37:02.070896 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09349de8_6a79_43e8_9676_0483fb702a86.slice/crio-f15a2eed506b48cb2d4b6491a74cc44bddb7eaff3311617856aced5d246ac596 WatchSource:0}: Error finding container f15a2eed506b48cb2d4b6491a74cc44bddb7eaff3311617856aced5d246ac596: Status 404 returned error can't find the container with id f15a2eed506b48cb2d4b6491a74cc44bddb7eaff3311617856aced5d246ac596 Oct 14 13:37:02.171171 master-0 kubenswrapper[4807]: W1014 13:37:02.171100 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1784e65_d184_40d4_b81e_2203c0fa2007.slice/crio-e53529e0528471681ffc51ab84595d5cd94841254b9d2833a7bedab51c49f0e2 WatchSource:0}: Error finding container e53529e0528471681ffc51ab84595d5cd94841254b9d2833a7bedab51c49f0e2: Status 404 returned error can't find the container with id e53529e0528471681ffc51ab84595d5cd94841254b9d2833a7bedab51c49f0e2 Oct 14 13:37:02.171418 master-0 kubenswrapper[4807]: I1014 13:37:02.171229 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/ironic-66b7ffc58b-797f7"] Oct 14 13:37:02.185651 master-0 kubenswrapper[4807]: I1014 13:37:02.185595 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:37:02.192501 master-0 kubenswrapper[4807]: W1014 13:37:02.192420 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19e03fbc_c711_42c7_bb67_8cabe23e697d.slice/crio-7d3b1d63af4af0405e121156479c050a4b1b5de2b8819a567d08bf224a299472 WatchSource:0}: Error finding container 7d3b1d63af4af0405e121156479c050a4b1b5de2b8819a567d08bf224a299472: Status 404 returned error can't find the container with id 7d3b1d63af4af0405e121156479c050a4b1b5de2b8819a567d08bf224a299472 Oct 14 13:37:02.607600 master-0 kubenswrapper[4807]: I1014 13:37:02.605438 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-6875d55546-w7958" event={"ID":"09349de8-6a79-43e8-9676-0483fb702a86","Type":"ContainerStarted","Data":"f15a2eed506b48cb2d4b6491a74cc44bddb7eaff3311617856aced5d246ac596"} Oct 14 13:37:02.610019 master-0 kubenswrapper[4807]: I1014 13:37:02.609928 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerStarted","Data":"6e418b73d060961770a350f72e6d44e1045e18b545ecc5ba3992d4fe66905dd5"} Oct 14 13:37:02.627853 master-0 kubenswrapper[4807]: I1014 13:37:02.627779 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerStarted","Data":"2519d8d28ed9accf8261b24ca89ea68d68fd15ba6cf29df4f5c3bce6df791146"} Oct 14 13:37:02.628148 master-0 kubenswrapper[4807]: I1014 13:37:02.627918 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerStarted","Data":"0910068d7e9a5f418e057af9c0417c171e7ae39dcf8dbc69b877a70a66e6f5bf"} Oct 14 13:37:02.644690 master-0 kubenswrapper[4807]: I1014 13:37:02.644513 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerStarted","Data":"708d2425b66963369777b90c58e472594c0a39154b5277a7b2abe514246c4177"} Oct 14 13:37:02.649542 master-0 kubenswrapper[4807]: I1014 13:37:02.648701 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerStarted","Data":"cb8a9fc96ac2aab628a99cd5f4873d989e7ecc3e88b50826bf0a463c0bcd44e2"} Oct 14 13:37:02.658383 master-0 kubenswrapper[4807]: I1014 13:37:02.658353 4807 generic.go:334] "Generic (PLEG): container finished" podID="19e03fbc-c711-42c7-bb67-8cabe23e697d" containerID="74287e12f5488ff8fffeba30284a2b08585faf2c6ae7ecc75ce41307be6040a5" exitCode=0 Oct 14 13:37:02.658564 master-0 kubenswrapper[4807]: I1014 13:37:02.658426 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" event={"ID":"19e03fbc-c711-42c7-bb67-8cabe23e697d","Type":"ContainerDied","Data":"74287e12f5488ff8fffeba30284a2b08585faf2c6ae7ecc75ce41307be6040a5"} Oct 14 13:37:02.658564 master-0 kubenswrapper[4807]: I1014 13:37:02.658448 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" event={"ID":"19e03fbc-c711-42c7-bb67-8cabe23e697d","Type":"ContainerStarted","Data":"7d3b1d63af4af0405e121156479c050a4b1b5de2b8819a567d08bf224a299472"} Oct 14 13:37:02.660735 master-0 kubenswrapper[4807]: I1014 13:37:02.660686 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-66b7ffc58b-797f7" event={"ID":"b1784e65-d184-40d4-b81e-2203c0fa2007","Type":"ContainerStarted","Data":"e53529e0528471681ffc51ab84595d5cd94841254b9d2833a7bedab51c49f0e2"} Oct 14 13:37:02.713815 master-0 kubenswrapper[4807]: I1014 13:37:02.713743 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-46645-volume-lvm-iscsi-0" podStartSLOduration=2.245244192 podStartE2EDuration="27.71372351s" podCreationTimestamp="2025-10-14 13:36:35 +0000 UTC" firstStartedPulling="2025-10-14 13:36:36.158051924 +0000 UTC m=+990.839353748" lastFinishedPulling="2025-10-14 13:37:01.626531242 +0000 UTC m=+1016.307833066" observedRunningTime="2025-10-14 13:37:02.665074819 +0000 UTC m=+1017.346376643" watchObservedRunningTime="2025-10-14 13:37:02.71372351 +0000 UTC m=+1017.395025334" Oct 14 13:37:03.235901 master-0 kubenswrapper[4807]: I1014 13:37:03.230622 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400163 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400254 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400321 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400374 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400408 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.401504 master-0 kubenswrapper[4807]: I1014 13:37:03.400629 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2g4v\" (UniqueName: \"kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v\") pod \"19e03fbc-c711-42c7-bb67-8cabe23e697d\" (UID: \"19e03fbc-c711-42c7-bb67-8cabe23e697d\") " Oct 14 13:37:03.414483 master-0 kubenswrapper[4807]: I1014 13:37:03.406611 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v" (OuterVolumeSpecName: "kube-api-access-j2g4v") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "kube-api-access-j2g4v". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:03.426478 master-0 kubenswrapper[4807]: I1014 13:37:03.425486 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:37:03.437479 master-0 kubenswrapper[4807]: I1014 13:37:03.437397 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:37:03.444379 master-0 kubenswrapper[4807]: I1014 13:37:03.442921 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:37:03.453109 master-0 kubenswrapper[4807]: I1014 13:37:03.453054 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:37:03.469130 master-0 kubenswrapper[4807]: I1014 13:37:03.468865 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config" (OuterVolumeSpecName: "config") pod "19e03fbc-c711-42c7-bb67-8cabe23e697d" (UID: "19e03fbc-c711-42c7-bb67-8cabe23e697d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:37:03.502935 master-0 kubenswrapper[4807]: I1014 13:37:03.502880 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-j2g4v\" (UniqueName: \"kubernetes.io/projected/19e03fbc-c711-42c7-bb67-8cabe23e697d-kube-api-access-j2g4v\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.502935 master-0 kubenswrapper[4807]: I1014 13:37:03.502934 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.503097 master-0 kubenswrapper[4807]: I1014 13:37:03.502948 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.503097 master-0 kubenswrapper[4807]: I1014 13:37:03.502986 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.503097 master-0 kubenswrapper[4807]: I1014 13:37:03.502997 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.503097 master-0 kubenswrapper[4807]: I1014 13:37:03.503006 4807 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/19e03fbc-c711-42c7-bb67-8cabe23e697d-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:03.686551 master-0 kubenswrapper[4807]: I1014 13:37:03.685230 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-46645-default-external-api-2" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-log" containerID="cri-o://6e418b73d060961770a350f72e6d44e1045e18b545ecc5ba3992d4fe66905dd5" gracePeriod=30 Oct 14 13:37:03.686551 master-0 kubenswrapper[4807]: I1014 13:37:03.685514 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerStarted","Data":"df7f6028af8790c422ee8e7baaefb5491dc3a276d851e36ed83dc79101845432"} Oct 14 13:37:03.686551 master-0 kubenswrapper[4807]: I1014 13:37:03.685659 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-46645-default-external-api-2" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-httpd" containerID="cri-o://df7f6028af8790c422ee8e7baaefb5491dc3a276d851e36ed83dc79101845432" gracePeriod=30 Oct 14 13:37:03.692511 master-0 kubenswrapper[4807]: I1014 13:37:03.692083 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerStarted","Data":"2c83a3d909900baff8a369a0f2a8f0ea76d95e40d64d7eb82ceeb818c4c3f3fb"} Oct 14 13:37:03.692511 master-0 kubenswrapper[4807]: I1014 13:37:03.692328 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-46645-api-1" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-46645-api-log" containerID="cri-o://708d2425b66963369777b90c58e472594c0a39154b5277a7b2abe514246c4177" gracePeriod=30 Oct 14 13:37:03.692511 master-0 kubenswrapper[4807]: I1014 13:37:03.692426 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/cinder-46645-api-1" Oct 14 13:37:03.692867 master-0 kubenswrapper[4807]: I1014 13:37:03.692575 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-46645-api-1" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-api" containerID="cri-o://2c83a3d909900baff8a369a0f2a8f0ea76d95e40d64d7eb82ceeb818c4c3f3fb" gracePeriod=30 Oct 14 13:37:03.698622 master-0 kubenswrapper[4807]: I1014 13:37:03.697069 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerStarted","Data":"947b93d3442a10a1b23fc7687efd7ddf69f6509ca1c0abc2a72e49f4cace408a"} Oct 14 13:37:03.705392 master-0 kubenswrapper[4807]: I1014 13:37:03.703747 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" Oct 14 13:37:03.705392 master-0 kubenswrapper[4807]: I1014 13:37:03.704032 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-798b8945b9-2b8d8" event={"ID":"19e03fbc-c711-42c7-bb67-8cabe23e697d","Type":"ContainerDied","Data":"7d3b1d63af4af0405e121156479c050a4b1b5de2b8819a567d08bf224a299472"} Oct 14 13:37:03.705392 master-0 kubenswrapper[4807]: I1014 13:37:03.704184 4807 scope.go:117] "RemoveContainer" containerID="74287e12f5488ff8fffeba30284a2b08585faf2c6ae7ecc75ce41307be6040a5" Oct 14 13:37:03.756760 master-0 kubenswrapper[4807]: I1014 13:37:03.756262 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-46645-default-external-api-2" podStartSLOduration=12.721284016 podStartE2EDuration="36.756238934s" podCreationTimestamp="2025-10-14 13:36:27 +0000 UTC" firstStartedPulling="2025-10-14 13:36:37.541439733 +0000 UTC m=+992.222741567" lastFinishedPulling="2025-10-14 13:37:01.576394661 +0000 UTC m=+1016.257696485" observedRunningTime="2025-10-14 13:37:03.718593085 +0000 UTC m=+1018.399894909" watchObservedRunningTime="2025-10-14 13:37:03.756238934 +0000 UTC m=+1018.437540758" Oct 14 13:37:03.760750 master-0 kubenswrapper[4807]: I1014 13:37:03.760662 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-46645-default-internal-api-2" podStartSLOduration=6.793474472 podStartE2EDuration="26.760640135s" podCreationTimestamp="2025-10-14 13:36:37 +0000 UTC" firstStartedPulling="2025-10-14 13:36:41.662827034 +0000 UTC m=+996.344128858" lastFinishedPulling="2025-10-14 13:37:01.629992697 +0000 UTC m=+1016.311294521" observedRunningTime="2025-10-14 13:37:03.756542463 +0000 UTC m=+1018.437844297" watchObservedRunningTime="2025-10-14 13:37:03.760640135 +0000 UTC m=+1018.441941959" Oct 14 13:37:03.792224 master-0 kubenswrapper[4807]: I1014 13:37:03.792101 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-46645-api-1" podStartSLOduration=3.556039798 podStartE2EDuration="27.792075945s" podCreationTimestamp="2025-10-14 13:36:36 +0000 UTC" firstStartedPulling="2025-10-14 13:36:37.346888382 +0000 UTC m=+992.028190206" lastFinishedPulling="2025-10-14 13:37:01.582924529 +0000 UTC m=+1016.264226353" observedRunningTime="2025-10-14 13:37:03.787401897 +0000 UTC m=+1018.468703731" watchObservedRunningTime="2025-10-14 13:37:03.792075945 +0000 UTC m=+1018.473377769" Oct 14 13:37:03.853493 master-0 kubenswrapper[4807]: I1014 13:37:03.849610 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:37:03.889497 master-0 kubenswrapper[4807]: I1014 13:37:03.888835 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-798b8945b9-2b8d8"] Oct 14 13:37:04.275231 master-0 kubenswrapper[4807]: I1014 13:37:04.275014 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19e03fbc-c711-42c7-bb67-8cabe23e697d" path="/var/lib/kubelet/pods/19e03fbc-c711-42c7-bb67-8cabe23e697d/volumes" Oct 14 13:37:04.717377 master-0 kubenswrapper[4807]: I1014 13:37:04.717314 4807 generic.go:334] "Generic (PLEG): container finished" podID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerID="2c83a3d909900baff8a369a0f2a8f0ea76d95e40d64d7eb82ceeb818c4c3f3fb" exitCode=0 Oct 14 13:37:04.717377 master-0 kubenswrapper[4807]: I1014 13:37:04.717355 4807 generic.go:334] "Generic (PLEG): container finished" podID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerID="708d2425b66963369777b90c58e472594c0a39154b5277a7b2abe514246c4177" exitCode=143 Oct 14 13:37:04.717662 master-0 kubenswrapper[4807]: I1014 13:37:04.717405 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerDied","Data":"2c83a3d909900baff8a369a0f2a8f0ea76d95e40d64d7eb82ceeb818c4c3f3fb"} Oct 14 13:37:04.717662 master-0 kubenswrapper[4807]: I1014 13:37:04.717443 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerDied","Data":"708d2425b66963369777b90c58e472594c0a39154b5277a7b2abe514246c4177"} Oct 14 13:37:04.722533 master-0 kubenswrapper[4807]: I1014 13:37:04.722500 4807 generic.go:334] "Generic (PLEG): container finished" podID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerID="df7f6028af8790c422ee8e7baaefb5491dc3a276d851e36ed83dc79101845432" exitCode=0 Oct 14 13:37:04.722533 master-0 kubenswrapper[4807]: I1014 13:37:04.722526 4807 generic.go:334] "Generic (PLEG): container finished" podID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerID="6e418b73d060961770a350f72e6d44e1045e18b545ecc5ba3992d4fe66905dd5" exitCode=143 Oct 14 13:37:04.724494 master-0 kubenswrapper[4807]: I1014 13:37:04.724441 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerDied","Data":"df7f6028af8790c422ee8e7baaefb5491dc3a276d851e36ed83dc79101845432"} Oct 14 13:37:04.724494 master-0 kubenswrapper[4807]: I1014 13:37:04.724485 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerDied","Data":"6e418b73d060961770a350f72e6d44e1045e18b545ecc5ba3992d4fe66905dd5"} Oct 14 13:37:05.306344 master-0 kubenswrapper[4807]: I1014 13:37:05.306291 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:05.307267 master-0 kubenswrapper[4807]: E1014 13:37:05.307250 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="19e03fbc-c711-42c7-bb67-8cabe23e697d" containerName="init" Oct 14 13:37:05.307337 master-0 kubenswrapper[4807]: I1014 13:37:05.307328 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="19e03fbc-c711-42c7-bb67-8cabe23e697d" containerName="init" Oct 14 13:37:05.307581 master-0 kubenswrapper[4807]: I1014 13:37:05.307568 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="19e03fbc-c711-42c7-bb67-8cabe23e697d" containerName="init" Oct 14 13:37:05.308451 master-0 kubenswrapper[4807]: I1014 13:37:05.308433 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.331434 master-0 kubenswrapper[4807]: I1014 13:37:05.331017 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:05.366321 master-0 kubenswrapper[4807]: I1014 13:37:05.366166 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.366541 master-0 kubenswrapper[4807]: I1014 13:37:05.366417 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.366763 master-0 kubenswrapper[4807]: I1014 13:37:05.366684 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.366856 master-0 kubenswrapper[4807]: I1014 13:37:05.366824 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9p8x\" (UniqueName: \"kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.469860 master-0 kubenswrapper[4807]: I1014 13:37:05.469816 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.470203 master-0 kubenswrapper[4807]: I1014 13:37:05.470189 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.470346 master-0 kubenswrapper[4807]: I1014 13:37:05.470333 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-g9p8x\" (UniqueName: \"kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.471393 master-0 kubenswrapper[4807]: I1014 13:37:05.471379 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.474450 master-0 kubenswrapper[4807]: I1014 13:37:05.474392 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.477306 master-0 kubenswrapper[4807]: I1014 13:37:05.477275 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.502061 master-0 kubenswrapper[4807]: I1014 13:37:05.502020 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.502341 master-0 kubenswrapper[4807]: I1014 13:37:05.502294 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9p8x\" (UniqueName: \"kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x\") pod \"heat-api-689594cfbc-cxfsp\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:05.602272 master-0 kubenswrapper[4807]: I1014 13:37:05.602210 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:05.638039 master-0 kubenswrapper[4807]: I1014 13:37:05.637842 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:06.566753 master-0 kubenswrapper[4807]: I1014 13:37:06.566283 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:37:06.871417 master-0 kubenswrapper[4807]: I1014 13:37:06.871341 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:06.871417 master-0 kubenswrapper[4807]: I1014 13:37:06.871411 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:08.933083 master-0 kubenswrapper[4807]: I1014 13:37:08.932979 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:37:08.935908 master-0 kubenswrapper[4807]: I1014 13:37:08.935513 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:08.939245 master-0 kubenswrapper[4807]: I1014 13:37:08.939177 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:37:08.939847 master-0 kubenswrapper[4807]: I1014 13:37:08.939611 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Oct 14 13:37:08.939847 master-0 kubenswrapper[4807]: I1014 13:37:08.939655 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:37:08.940149 master-0 kubenswrapper[4807]: I1014 13:37:08.940093 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:37:08.940789 master-0 kubenswrapper[4807]: I1014 13:37:08.940729 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:37:08.951167 master-0 kubenswrapper[4807]: I1014 13:37:08.951116 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:37:08.979320 master-0 kubenswrapper[4807]: I1014 13:37:08.979234 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:08.979935 master-0 kubenswrapper[4807]: I1014 13:37:08.979614 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-46645-default-internal-api-2" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-log" containerID="cri-o://cb8a9fc96ac2aab628a99cd5f4873d989e7ecc3e88b50826bf0a463c0bcd44e2" gracePeriod=30 Oct 14 13:37:08.980125 master-0 kubenswrapper[4807]: I1014 13:37:08.980088 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/glance-46645-default-internal-api-2" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-httpd" containerID="cri-o://947b93d3442a10a1b23fc7687efd7ddf69f6509ca1c0abc2a72e49f4cace408a" gracePeriod=30 Oct 14 13:37:09.066444 master-0 kubenswrapper[4807]: I1014 13:37:09.066308 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hgtn\" (UniqueName: \"kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.066875 master-0 kubenswrapper[4807]: I1014 13:37:09.066696 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.066875 master-0 kubenswrapper[4807]: I1014 13:37:09.066741 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.066875 master-0 kubenswrapper[4807]: I1014 13:37:09.066831 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.067110 master-0 kubenswrapper[4807]: I1014 13:37:09.066918 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.067110 master-0 kubenswrapper[4807]: I1014 13:37:09.066986 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169195 master-0 kubenswrapper[4807]: I1014 13:37:09.169121 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7hgtn\" (UniqueName: \"kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169589 master-0 kubenswrapper[4807]: I1014 13:37:09.169238 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169589 master-0 kubenswrapper[4807]: I1014 13:37:09.169274 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169589 master-0 kubenswrapper[4807]: I1014 13:37:09.169299 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169589 master-0 kubenswrapper[4807]: I1014 13:37:09.169506 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.169589 master-0 kubenswrapper[4807]: I1014 13:37:09.169565 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.170660 master-0 kubenswrapper[4807]: I1014 13:37:09.170601 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.170721 master-0 kubenswrapper[4807]: I1014 13:37:09.170631 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.170829 master-0 kubenswrapper[4807]: I1014 13:37:09.170793 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.170875 master-0 kubenswrapper[4807]: I1014 13:37:09.170796 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.171043 master-0 kubenswrapper[4807]: I1014 13:37:09.170971 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.198727 master-0 kubenswrapper[4807]: I1014 13:37:09.198430 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hgtn\" (UniqueName: \"kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn\") pod \"dnsmasq-dns-6f8b568997-sphlq\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.255376 master-0 kubenswrapper[4807]: I1014 13:37:09.255208 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:09.781859 master-0 kubenswrapper[4807]: I1014 13:37:09.780887 4807 generic.go:334] "Generic (PLEG): container finished" podID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerID="947b93d3442a10a1b23fc7687efd7ddf69f6509ca1c0abc2a72e49f4cace408a" exitCode=0 Oct 14 13:37:09.781859 master-0 kubenswrapper[4807]: I1014 13:37:09.781210 4807 generic.go:334] "Generic (PLEG): container finished" podID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerID="cb8a9fc96ac2aab628a99cd5f4873d989e7ecc3e88b50826bf0a463c0bcd44e2" exitCode=143 Oct 14 13:37:09.781859 master-0 kubenswrapper[4807]: I1014 13:37:09.781254 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerDied","Data":"947b93d3442a10a1b23fc7687efd7ddf69f6509ca1c0abc2a72e49f4cace408a"} Oct 14 13:37:09.781859 master-0 kubenswrapper[4807]: I1014 13:37:09.781292 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerDied","Data":"cb8a9fc96ac2aab628a99cd5f4873d989e7ecc3e88b50826bf0a463c0bcd44e2"} Oct 14 13:37:10.884646 master-0 kubenswrapper[4807]: I1014 13:37:10.884573 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:10.903836 master-0 kubenswrapper[4807]: I1014 13:37:10.903768 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:10.903836 master-0 kubenswrapper[4807]: I1014 13:37:10.903837 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:10.946041 master-0 kubenswrapper[4807]: I1014 13:37:10.945977 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:11.797473 master-0 kubenswrapper[4807]: I1014 13:37:11.797392 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-46645-volume-lvm-iscsi-0" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="cinder-volume" containerID="cri-o://0910068d7e9a5f418e057af9c0417c171e7ae39dcf8dbc69b877a70a66e6f5bf" gracePeriod=30 Oct 14 13:37:11.798928 master-0 kubenswrapper[4807]: I1014 13:37:11.798110 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/cinder-46645-volume-lvm-iscsi-0" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="probe" containerID="cri-o://2519d8d28ed9accf8261b24ca89ea68d68fd15ba6cf29df4f5c3bce6df791146" gracePeriod=30 Oct 14 13:37:12.804942 master-0 kubenswrapper[4807]: I1014 13:37:12.802632 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:37:12.830297 master-0 kubenswrapper[4807]: I1014 13:37:12.824587 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"93e5f9fd-a08d-463d-8954-e256e6d89efa","Type":"ContainerDied","Data":"0261672d53de1489335a4101d8ce3fdda5adc5a1a218163c803b3fa9e4993bb9"} Oct 14 13:37:12.830297 master-0 kubenswrapper[4807]: I1014 13:37:12.824653 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0261672d53de1489335a4101d8ce3fdda5adc5a1a218163c803b3fa9e4993bb9" Oct 14 13:37:12.831007 master-0 kubenswrapper[4807]: I1014 13:37:12.830949 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:12.832960 master-0 kubenswrapper[4807]: I1014 13:37:12.832911 4807 generic.go:334] "Generic (PLEG): container finished" podID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerID="2519d8d28ed9accf8261b24ca89ea68d68fd15ba6cf29df4f5c3bce6df791146" exitCode=0 Oct 14 13:37:12.832960 master-0 kubenswrapper[4807]: I1014 13:37:12.832942 4807 generic.go:334] "Generic (PLEG): container finished" podID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerID="0910068d7e9a5f418e057af9c0417c171e7ae39dcf8dbc69b877a70a66e6f5bf" exitCode=0 Oct 14 13:37:12.833067 master-0 kubenswrapper[4807]: I1014 13:37:12.832987 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerDied","Data":"2519d8d28ed9accf8261b24ca89ea68d68fd15ba6cf29df4f5c3bce6df791146"} Oct 14 13:37:12.833067 master-0 kubenswrapper[4807]: I1014 13:37:12.833020 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerDied","Data":"0910068d7e9a5f418e057af9c0417c171e7ae39dcf8dbc69b877a70a66e6f5bf"} Oct 14 13:37:12.836739 master-0 kubenswrapper[4807]: I1014 13:37:12.836699 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"de8d4188-287e-4f7b-a774-098ca7e110fd","Type":"ContainerDied","Data":"dc53605e5c3eff6df9efd76caa0d89493f9ef298861ac7db0adba7bcb6e9434f"} Oct 14 13:37:12.836820 master-0 kubenswrapper[4807]: I1014 13:37:12.836748 4807 scope.go:117] "RemoveContainer" containerID="2c83a3d909900baff8a369a0f2a8f0ea76d95e40d64d7eb82ceeb818c4c3f3fb" Oct 14 13:37:12.836928 master-0 kubenswrapper[4807]: I1014 13:37:12.836854 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:37:12.955818 master-0 kubenswrapper[4807]: I1014 13:37:12.955732 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956062 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956097 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956186 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956207 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956357 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2c4w9\" (UniqueName: \"kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956392 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956452 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.956529 master-0 kubenswrapper[4807]: I1014 13:37:12.956541 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956567 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956654 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956680 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pkwb\" (UniqueName: \"kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956741 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956768 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs\") pod \"de8d4188-287e-4f7b-a774-098ca7e110fd\" (UID: \"de8d4188-287e-4f7b-a774-098ca7e110fd\") " Oct 14 13:37:12.957247 master-0 kubenswrapper[4807]: I1014 13:37:12.956806 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts\") pod \"93e5f9fd-a08d-463d-8954-e256e6d89efa\" (UID: \"93e5f9fd-a08d-463d-8954-e256e6d89efa\") " Oct 14 13:37:12.957768 master-0 kubenswrapper[4807]: I1014 13:37:12.957746 4807 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-httpd-run\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:12.957850 master-0 kubenswrapper[4807]: I1014 13:37:12.957790 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs" (OuterVolumeSpecName: "logs") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:37:12.958235 master-0 kubenswrapper[4807]: I1014 13:37:12.958179 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:12.961909 master-0 kubenswrapper[4807]: I1014 13:37:12.958619 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs" (OuterVolumeSpecName: "logs") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:37:12.961909 master-0 kubenswrapper[4807]: I1014 13:37:12.961603 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts" (OuterVolumeSpecName: "scripts") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:12.961909 master-0 kubenswrapper[4807]: I1014 13:37:12.961721 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:12.961909 master-0 kubenswrapper[4807]: I1014 13:37:12.961762 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9" (OuterVolumeSpecName: "kube-api-access-2c4w9") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "kube-api-access-2c4w9". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:12.974427 master-0 kubenswrapper[4807]: I1014 13:37:12.972766 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts" (OuterVolumeSpecName: "scripts") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:12.974427 master-0 kubenswrapper[4807]: I1014 13:37:12.973084 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb" (OuterVolumeSpecName: "kube-api-access-2pkwb") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "kube-api-access-2pkwb". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:12.981296 master-0 kubenswrapper[4807]: I1014 13:37:12.981226 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601" (OuterVolumeSpecName: "glance") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "pvc-f08827e1-c2ac-418d-bf94-3501d5cec206". PluginName "kubernetes.io/csi", VolumeGidValue "" Oct 14 13:37:12.987757 master-0 kubenswrapper[4807]: I1014 13:37:12.987108 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.000006 master-0 kubenswrapper[4807]: I1014 13:37:12.999947 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.024197 master-0 kubenswrapper[4807]: I1014 13:37:13.024138 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data" (OuterVolumeSpecName: "config-data") pod "93e5f9fd-a08d-463d-8954-e256e6d89efa" (UID: "93e5f9fd-a08d-463d-8954-e256e6d89efa"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.030948 master-0 kubenswrapper[4807]: I1014 13:37:13.030861 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data" (OuterVolumeSpecName: "config-data") pod "de8d4188-287e-4f7b-a774-098ca7e110fd" (UID: "de8d4188-287e-4f7b-a774-098ca7e110fd"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.059542 master-0 kubenswrapper[4807]: I1014 13:37:13.059465 4807 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") on node \"master-0\" " Oct 14 13:37:13.059542 master-0 kubenswrapper[4807]: I1014 13:37:13.059529 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059542 master-0 kubenswrapper[4807]: I1014 13:37:13.059545 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059542 master-0 kubenswrapper[4807]: I1014 13:37:13.059556 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2c4w9\" (UniqueName: \"kubernetes.io/projected/de8d4188-287e-4f7b-a774-098ca7e110fd-kube-api-access-2c4w9\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059573 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059583 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/93e5f9fd-a08d-463d-8954-e256e6d89efa-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059594 4807 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059603 4807 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/de8d4188-287e-4f7b-a774-098ca7e110fd-config-data-custom\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059612 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059621 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-2pkwb\" (UniqueName: \"kubernetes.io/projected/93e5f9fd-a08d-463d-8954-e256e6d89efa-kube-api-access-2pkwb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059631 4807 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/de8d4188-287e-4f7b-a774-098ca7e110fd-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059639 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/de8d4188-287e-4f7b-a774-098ca7e110fd-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.059927 master-0 kubenswrapper[4807]: I1014 13:37:13.059648 4807 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/93e5f9fd-a08d-463d-8954-e256e6d89efa-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.075548 master-0 kubenswrapper[4807]: I1014 13:37:13.075497 4807 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Oct 14 13:37:13.075786 master-0 kubenswrapper[4807]: I1014 13:37:13.075686 4807 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-f08827e1-c2ac-418d-bf94-3501d5cec206" (UniqueName: "kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601") on node "master-0" Oct 14 13:37:13.161779 master-0 kubenswrapper[4807]: I1014 13:37:13.161696 4807 reconciler_common.go:293] "Volume detached for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.261023 master-0 kubenswrapper[4807]: I1014 13:37:13.260966 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"rabbitmq-transport-url-ironic-transport" Oct 14 13:37:13.276975 master-0 kubenswrapper[4807]: I1014 13:37:13.276897 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:13.301643 master-0 kubenswrapper[4807]: I1014 13:37:13.301590 4807 scope.go:117] "RemoveContainer" containerID="708d2425b66963369777b90c58e472594c0a39154b5277a7b2abe514246c4177" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366502 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366580 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366650 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366667 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id" (OuterVolumeSpecName: "etc-machine-id") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "etc-machine-id". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366730 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366750 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules" (OuterVolumeSpecName: "lib-modules") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "lib-modules". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366777 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme" (OuterVolumeSpecName: "etc-nvme") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "etc-nvme". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366802 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366827 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder" (OuterVolumeSpecName: "var-locks-cinder") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "var-locks-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366863 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366892 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366912 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi" (OuterVolumeSpecName: "etc-iscsi") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "etc-iscsi". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.366964 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.367035 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.367051 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.367089 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run" (OuterVolumeSpecName: "run") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "run". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367077 master-0 kubenswrapper[4807]: I1014 13:37:13.367106 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367141 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367194 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-697ps\" (UniqueName: \"kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367218 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367265 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev" (OuterVolumeSpecName: "dev") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "dev". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367298 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data\") pod \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\" (UID: \"8e4d4896-9b3d-4104-8c4a-0d85698d7850\") " Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367612 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder" (OuterVolumeSpecName: "var-lib-cinder") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "var-lib-cinder". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367646 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys" (OuterVolumeSpecName: "sys") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "sys". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.367794 master-0 kubenswrapper[4807]: I1014 13:37:13.367678 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick" (OuterVolumeSpecName: "var-locks-brick") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "var-locks-brick". PluginName "kubernetes.io/host-path", VolumeGidValue "" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367895 4807 reconciler_common.go:293] "Volume detached for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-iscsi\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367920 4807 reconciler_common.go:293] "Volume detached for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-run\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367931 4807 reconciler_common.go:293] "Volume detached for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-dev\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367939 4807 reconciler_common.go:293] "Volume detached for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-sys\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367964 4807 reconciler_common.go:293] "Volume detached for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-lib-cinder\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367975 4807 reconciler_common.go:293] "Volume detached for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-brick\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367984 4807 reconciler_common.go:293] "Volume detached for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-machine-id\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.367993 4807 reconciler_common.go:293] "Volume detached for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-lib-modules\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.368001 4807 reconciler_common.go:293] "Volume detached for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-etc-nvme\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.368080 master-0 kubenswrapper[4807]: I1014 13:37:13.368076 4807 reconciler_common.go:293] "Volume detached for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/8e4d4896-9b3d-4104-8c4a-0d85698d7850-var-locks-cinder\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.371027 master-0 kubenswrapper[4807]: I1014 13:37:13.370979 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.371104 master-0 kubenswrapper[4807]: I1014 13:37:13.371067 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts" (OuterVolumeSpecName: "scripts") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.371508 master-0 kubenswrapper[4807]: I1014 13:37:13.371420 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps" (OuterVolumeSpecName: "kube-api-access-697ps") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "kube-api-access-697ps". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:13.455603 master-0 kubenswrapper[4807]: I1014 13:37:13.453206 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.469572 master-0 kubenswrapper[4807]: I1014 13:37:13.469512 4807 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data-custom\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.469572 master-0 kubenswrapper[4807]: I1014 13:37:13.469549 4807 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.469572 master-0 kubenswrapper[4807]: I1014 13:37:13.469561 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.469572 master-0 kubenswrapper[4807]: I1014 13:37:13.469572 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-697ps\" (UniqueName: \"kubernetes.io/projected/8e4d4896-9b3d-4104-8c4a-0d85698d7850-kube-api-access-697ps\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.473768 master-0 kubenswrapper[4807]: I1014 13:37:13.473703 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data" (OuterVolumeSpecName: "config-data") pod "8e4d4896-9b3d-4104-8c4a-0d85698d7850" (UID: "8e4d4896-9b3d-4104-8c4a-0d85698d7850"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:13.571806 master-0 kubenswrapper[4807]: I1014 13:37:13.571742 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/8e4d4896-9b3d-4104-8c4a-0d85698d7850-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:13.709714 master-0 kubenswrapper[4807]: I1014 13:37:13.709552 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:37:13.851643 master-0 kubenswrapper[4807]: I1014 13:37:13.851493 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"8e4d4896-9b3d-4104-8c4a-0d85698d7850","Type":"ContainerDied","Data":"c14766eef29f75b4fcc64fc252a81041a6fc3960f7848c67c87a1005e6c6ba1f"} Oct 14 13:37:13.852184 master-0 kubenswrapper[4807]: I1014 13:37:13.851542 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:13.852184 master-0 kubenswrapper[4807]: I1014 13:37:13.851779 4807 scope.go:117] "RemoveContainer" containerID="2519d8d28ed9accf8261b24ca89ea68d68fd15ba6cf29df4f5c3bce6df791146" Oct 14 13:37:13.855147 master-0 kubenswrapper[4807]: I1014 13:37:13.855103 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-66b7ffc58b-797f7" event={"ID":"b1784e65-d184-40d4-b81e-2203c0fa2007","Type":"ContainerStarted","Data":"ef8c99a3a125f5f1e9467e7e27718eccacd94dac3e76095d866060a129b67a33"} Oct 14 13:37:13.856892 master-0 kubenswrapper[4807]: I1014 13:37:13.856854 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-689594cfbc-cxfsp" event={"ID":"eee60379-0b05-408a-9cea-54b9f2764937","Type":"ContainerStarted","Data":"f2be044cf9a34e050b3fe475ade5b0f07930690da11d8dc36960bde81bd5c2b8"} Oct 14 13:37:13.859811 master-0 kubenswrapper[4807]: I1014 13:37:13.859757 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-6875d55546-w7958" event={"ID":"09349de8-6a79-43e8-9676-0483fb702a86","Type":"ContainerStarted","Data":"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e"} Oct 14 13:37:13.859940 master-0 kubenswrapper[4807]: I1014 13:37:13.859914 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:37:13.859985 master-0 kubenswrapper[4807]: I1014 13:37:13.859865 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/heat-api-6875d55546-w7958" podUID="09349de8-6a79-43e8-9676-0483fb702a86" containerName="heat-api" containerID="cri-o://d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e" gracePeriod=60 Oct 14 13:37:13.860015 master-0 kubenswrapper[4807]: I1014 13:37:13.859990 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:13.926480 master-0 kubenswrapper[4807]: I1014 13:37:13.922019 4807 scope.go:117] "RemoveContainer" containerID="0910068d7e9a5f418e057af9c0417c171e7ae39dcf8dbc69b877a70a66e6f5bf" Oct 14 13:37:13.950015 master-0 kubenswrapper[4807]: I1014 13:37:13.947712 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:13.981060 master-0 kubenswrapper[4807]: I1014 13:37:13.980824 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:37:13.989871 master-0 kubenswrapper[4807]: I1014 13:37:13.989804 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:14.088622 master-0 kubenswrapper[4807]: I1014 13:37:14.088547 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.088864 master-0 kubenswrapper[4807]: I1014 13:37:14.088637 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.088864 master-0 kubenswrapper[4807]: I1014 13:37:14.088756 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.088864 master-0 kubenswrapper[4807]: I1014 13:37:14.088852 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.089031 master-0 kubenswrapper[4807]: I1014 13:37:14.088846 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs" (OuterVolumeSpecName: "logs") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:37:14.089031 master-0 kubenswrapper[4807]: I1014 13:37:14.088984 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.089146 master-0 kubenswrapper[4807]: I1014 13:37:14.089111 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run" (OuterVolumeSpecName: "httpd-run") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "httpd-run". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:37:14.089146 master-0 kubenswrapper[4807]: I1014 13:37:14.089131 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.089346 master-0 kubenswrapper[4807]: I1014 13:37:14.089310 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"glance\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.089399 master-0 kubenswrapper[4807]: I1014 13:37:14.089371 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtmnv\" (UniqueName: \"kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv\") pod \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\" (UID: \"16c0ea67-fb7f-4e96-9cc5-4da186d26c08\") " Oct 14 13:37:14.090321 master-0 kubenswrapper[4807]: I1014 13:37:14.090285 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.090321 master-0 kubenswrapper[4807]: I1014 13:37:14.090303 4807 reconciler_common.go:293] "Volume detached for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-httpd-run\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.092885 master-0 kubenswrapper[4807]: I1014 13:37:14.092825 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts" (OuterVolumeSpecName: "scripts") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "scripts". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:14.092998 master-0 kubenswrapper[4807]: I1014 13:37:14.092852 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv" (OuterVolumeSpecName: "kube-api-access-rtmnv") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "kube-api-access-rtmnv". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:14.113193 master-0 kubenswrapper[4807]: I1014 13:37:14.113088 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f" (OuterVolumeSpecName: "glance") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "pvc-b255fe27-269c-4613-982c-72c563ea8ebd". PluginName "kubernetes.io/csi", VolumeGidValue "" Oct 14 13:37:14.115783 master-0 kubenswrapper[4807]: E1014 13:37:14.115735 4807 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1784e65_d184_40d4_b81e_2203c0fa2007.slice/crio-ef8c99a3a125f5f1e9467e7e27718eccacd94dac3e76095d866060a129b67a33.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb1784e65_d184_40d4_b81e_2203c0fa2007.slice/crio-conmon-ef8c99a3a125f5f1e9467e7e27718eccacd94dac3e76095d866060a129b67a33.scope\": RecentStats: unable to find data in memory cache]" Oct 14 13:37:14.136242 master-0 kubenswrapper[4807]: I1014 13:37:14.136157 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:14.145987 master-0 kubenswrapper[4807]: I1014 13:37:14.145887 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs" (OuterVolumeSpecName: "internal-tls-certs") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "internal-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:14.158241 master-0 kubenswrapper[4807]: I1014 13:37:14.158153 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data" (OuterVolumeSpecName: "config-data") pod "16c0ea67-fb7f-4e96-9cc5-4da186d26c08" (UID: "16c0ea67-fb7f-4e96-9cc5-4da186d26c08"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192619 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192744 4807 reconciler_common.go:286] "operationExecutor.UnmountDevice started for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") on node \"master-0\" " Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192764 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rtmnv\" (UniqueName: \"kubernetes.io/projected/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-kube-api-access-rtmnv\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192780 4807 reconciler_common.go:293] "Volume detached for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-scripts\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192790 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.193277 master-0 kubenswrapper[4807]: I1014 13:37:14.192801 4807 reconciler_common.go:293] "Volume detached for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/16c0ea67-fb7f-4e96-9cc5-4da186d26c08-internal-tls-certs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.217411 master-0 kubenswrapper[4807]: I1014 13:37:14.217304 4807 csi_attacher.go:630] kubernetes.io/csi: attacher.UnmountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping UnmountDevice... Oct 14 13:37:14.217787 master-0 kubenswrapper[4807]: I1014 13:37:14.217557 4807 operation_generator.go:917] UnmountDevice succeeded for volume "pvc-b255fe27-269c-4613-982c-72c563ea8ebd" (UniqueName: "kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f") on node "master-0" Oct 14 13:37:14.225276 master-0 kubenswrapper[4807]: I1014 13:37:14.225184 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:37:14.225966 master-0 kubenswrapper[4807]: E1014 13:37:14.225925 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-api" Oct 14 13:37:14.225966 master-0 kubenswrapper[4807]: I1014 13:37:14.225963 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-api" Oct 14 13:37:14.226075 master-0 kubenswrapper[4807]: E1014 13:37:14.225992 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-log" Oct 14 13:37:14.226075 master-0 kubenswrapper[4807]: I1014 13:37:14.226006 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-log" Oct 14 13:37:14.226075 master-0 kubenswrapper[4807]: E1014 13:37:14.226038 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-46645-api-log" Oct 14 13:37:14.226075 master-0 kubenswrapper[4807]: I1014 13:37:14.226051 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-46645-api-log" Oct 14 13:37:14.226075 master-0 kubenswrapper[4807]: E1014 13:37:14.226072 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-httpd" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226085 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-httpd" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: E1014 13:37:14.226109 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="cinder-volume" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226122 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="cinder-volume" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: E1014 13:37:14.226139 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-httpd" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226151 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-httpd" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: E1014 13:37:14.226178 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="probe" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226190 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="probe" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: E1014 13:37:14.226212 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-log" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226224 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-log" Oct 14 13:37:14.226493 master-0 kubenswrapper[4807]: I1014 13:37:14.226444 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-api" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226513 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="cinder-volume" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226532 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-httpd" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226553 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" containerName="probe" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226569 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-log" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226594 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-46645-api-log" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226621 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" containerName="glance-log" Oct 14 13:37:14.227199 master-0 kubenswrapper[4807]: I1014 13:37:14.226637 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" containerName="glance-httpd" Oct 14 13:37:14.228242 master-0 kubenswrapper[4807]: I1014 13:37:14.228200 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.231923 master-0 kubenswrapper[4807]: I1014 13:37:14.231863 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-scripts" Oct 14 13:37:14.232004 master-0 kubenswrapper[4807]: I1014 13:37:14.231982 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-api-config-data" Oct 14 13:37:14.232056 master-0 kubenswrapper[4807]: I1014 13:37:14.231866 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-config-data" Oct 14 13:37:14.232250 master-0 kubenswrapper[4807]: I1014 13:37:14.232213 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-public-svc" Oct 14 13:37:14.234908 master-0 kubenswrapper[4807]: I1014 13:37:14.234881 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-cinder-internal-svc" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.293899 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294012 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-scripts\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294054 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pq7h\" (UniqueName: \"kubernetes.io/projected/31f8c441-8b98-4491-98fb-254ea7a94467-kube-api-access-8pq7h\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294112 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-public-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294150 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/31f8c441-8b98-4491-98fb-254ea7a94467-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294179 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-internal-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294214 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294241 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294263 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31f8c441-8b98-4491-98fb-254ea7a94467-logs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.298502 master-0 kubenswrapper[4807]: I1014 13:37:14.294325 4807 reconciler_common.go:293] "Volume detached for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:14.323500 master-0 kubenswrapper[4807]: I1014 13:37:14.319369 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" path="/var/lib/kubelet/pods/de8d4188-287e-4f7b-a774-098ca7e110fd/volumes" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.395955 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-internal-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396035 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396073 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396098 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31f8c441-8b98-4491-98fb-254ea7a94467-logs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396138 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396200 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-scripts\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396230 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8pq7h\" (UniqueName: \"kubernetes.io/projected/31f8c441-8b98-4491-98fb-254ea7a94467-kube-api-access-8pq7h\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396286 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-public-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396321 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/31f8c441-8b98-4491-98fb-254ea7a94467-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.396416 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/31f8c441-8b98-4491-98fb-254ea7a94467-etc-machine-id\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.406553 master-0 kubenswrapper[4807]: I1014 13:37:14.400207 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-internal-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.407735 master-0 kubenswrapper[4807]: I1014 13:37:14.407640 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-public-tls-certs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.411603 master-0 kubenswrapper[4807]: I1014 13:37:14.411558 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:37:14.412098 master-0 kubenswrapper[4807]: I1014 13:37:14.412023 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/31f8c441-8b98-4491-98fb-254ea7a94467-logs\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.414235 master-0 kubenswrapper[4807]: I1014 13:37:14.413666 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.420466 master-0 kubenswrapper[4807]: I1014 13:37:14.420381 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-combined-ca-bundle\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.439615 master-0 kubenswrapper[4807]: I1014 13:37:14.439548 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-scripts\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.441322 master-0 kubenswrapper[4807]: I1014 13:37:14.441276 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/31f8c441-8b98-4491-98fb-254ea7a94467-config-data-custom\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.467699 master-0 kubenswrapper[4807]: I1014 13:37:14.467405 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:37:14.495427 master-0 kubenswrapper[4807]: W1014 13:37:14.495354 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f7543ce_015a_4f01_985f_b76efd804110.slice/crio-5eb144563c6e3ee8b29ebc42ec9fb0500a353088c3d788d635c606494ecba67e WatchSource:0}: Error finding container 5eb144563c6e3ee8b29ebc42ec9fb0500a353088c3d788d635c606494ecba67e: Status 404 returned error can't find the container with id 5eb144563c6e3ee8b29ebc42ec9fb0500a353088c3d788d635c606494ecba67e Oct 14 13:37:14.650743 master-0 kubenswrapper[4807]: I1014 13:37:14.650673 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:37:14.653245 master-0 kubenswrapper[4807]: I1014 13:37:14.653016 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pq7h\" (UniqueName: \"kubernetes.io/projected/31f8c441-8b98-4491-98fb-254ea7a94467-kube-api-access-8pq7h\") pod \"cinder-46645-api-1\" (UID: \"31f8c441-8b98-4491-98fb-254ea7a94467\") " pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.697811 master-0 kubenswrapper[4807]: I1014 13:37:14.697721 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:37:14.853957 master-0 kubenswrapper[4807]: I1014 13:37:14.853819 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-api-1" Oct 14 13:37:14.881337 master-0 kubenswrapper[4807]: I1014 13:37:14.881251 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"16c0ea67-fb7f-4e96-9cc5-4da186d26c08","Type":"ContainerDied","Data":"b3639be31d3de0ef723506b67d6e9bc3590a5e23de3564175d3c2794d8774259"} Oct 14 13:37:14.881539 master-0 kubenswrapper[4807]: I1014 13:37:14.881351 4807 scope.go:117] "RemoveContainer" containerID="947b93d3442a10a1b23fc7687efd7ddf69f6509ca1c0abc2a72e49f4cace408a" Oct 14 13:37:14.881756 master-0 kubenswrapper[4807]: I1014 13:37:14.881714 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:14.883122 master-0 kubenswrapper[4807]: I1014 13:37:14.883022 4807 generic.go:334] "Generic (PLEG): container finished" podID="b1784e65-d184-40d4-b81e-2203c0fa2007" containerID="ef8c99a3a125f5f1e9467e7e27718eccacd94dac3e76095d866060a129b67a33" exitCode=0 Oct 14 13:37:14.883122 master-0 kubenswrapper[4807]: I1014 13:37:14.883093 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-66b7ffc58b-797f7" event={"ID":"b1784e65-d184-40d4-b81e-2203c0fa2007","Type":"ContainerDied","Data":"ef8c99a3a125f5f1e9467e7e27718eccacd94dac3e76095d866060a129b67a33"} Oct 14 13:37:14.886936 master-0 kubenswrapper[4807]: I1014 13:37:14.886885 4807 generic.go:334] "Generic (PLEG): container finished" podID="eee60379-0b05-408a-9cea-54b9f2764937" containerID="cf9f5e9760b97eed019d602084a6bbda79039f569e7ee68cccd0f93b4c2ac253" exitCode=1 Oct 14 13:37:14.887018 master-0 kubenswrapper[4807]: I1014 13:37:14.886990 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-689594cfbc-cxfsp" event={"ID":"eee60379-0b05-408a-9cea-54b9f2764937","Type":"ContainerDied","Data":"cf9f5e9760b97eed019d602084a6bbda79039f569e7ee68cccd0f93b4c2ac253"} Oct 14 13:37:14.887960 master-0 kubenswrapper[4807]: I1014 13:37:14.887910 4807 scope.go:117] "RemoveContainer" containerID="cf9f5e9760b97eed019d602084a6bbda79039f569e7ee68cccd0f93b4c2ac253" Oct 14 13:37:14.888570 master-0 kubenswrapper[4807]: I1014 13:37:14.888532 4807 generic.go:334] "Generic (PLEG): container finished" podID="7f7543ce-015a-4f01-985f-b76efd804110" containerID="de25711026901643293d9a08525d7de594181e968633388d08f9380cf9cd8e11" exitCode=0 Oct 14 13:37:14.888652 master-0 kubenswrapper[4807]: I1014 13:37:14.888581 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" event={"ID":"7f7543ce-015a-4f01-985f-b76efd804110","Type":"ContainerDied","Data":"de25711026901643293d9a08525d7de594181e968633388d08f9380cf9cd8e11"} Oct 14 13:37:14.888652 master-0 kubenswrapper[4807]: I1014 13:37:14.888622 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" event={"ID":"7f7543ce-015a-4f01-985f-b76efd804110","Type":"ContainerStarted","Data":"5eb144563c6e3ee8b29ebc42ec9fb0500a353088c3d788d635c606494ecba67e"} Oct 14 13:37:15.100064 master-0 kubenswrapper[4807]: I1014 13:37:15.099497 4807 scope.go:117] "RemoveContainer" containerID="cb8a9fc96ac2aab628a99cd5f4873d989e7ecc3e88b50826bf0a463c0bcd44e2" Oct 14 13:37:15.316833 master-0 kubenswrapper[4807]: I1014 13:37:15.316644 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/heat-api-6875d55546-w7958" podStartSLOduration=6.060560608 podStartE2EDuration="17.31661416s" podCreationTimestamp="2025-10-14 13:36:58 +0000 UTC" firstStartedPulling="2025-10-14 13:37:02.074707131 +0000 UTC m=+1016.756008955" lastFinishedPulling="2025-10-14 13:37:13.330760683 +0000 UTC m=+1028.012062507" observedRunningTime="2025-10-14 13:37:15.249151615 +0000 UTC m=+1029.930453439" watchObservedRunningTime="2025-10-14 13:37:15.31661416 +0000 UTC m=+1029.997915984" Oct 14 13:37:15.371617 master-0 kubenswrapper[4807]: I1014 13:37:15.371551 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:37:15.373557 master-0 kubenswrapper[4807]: I1014 13:37:15.373050 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.408493 master-0 kubenswrapper[4807]: I1014 13:37:15.408271 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-46645-default-external-config-data" Oct 14 13:37:15.408748 master-0 kubenswrapper[4807]: I1014 13:37:15.408552 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-scripts" Oct 14 13:37:15.408748 master-0 kubenswrapper[4807]: I1014 13:37:15.408707 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-public-svc" Oct 14 13:37:15.441570 master-0 kubenswrapper[4807]: I1014 13:37:15.432958 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:37:15.483251 master-0 kubenswrapper[4807]: W1014 13:37:15.483188 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod31f8c441_8b98_4491_98fb_254ea7a94467.slice/crio-e183d7e639bc34e08b7ff63f2c36a0ef16338af826eb6540481fb367b7055cb9 WatchSource:0}: Error finding container e183d7e639bc34e08b7ff63f2c36a0ef16338af826eb6540481fb367b7055cb9: Status 404 returned error can't find the container with id e183d7e639bc34e08b7ff63f2c36a0ef16338af826eb6540481fb367b7055cb9 Oct 14 13:37:15.539253 master-0 kubenswrapper[4807]: I1014 13:37:15.538130 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-api-1"] Oct 14 13:37:15.571318 master-0 kubenswrapper[4807]: I1014 13:37:15.571166 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.571318 master-0 kubenswrapper[4807]: I1014 13:37:15.571248 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzf26\" (UniqueName: \"kubernetes.io/projected/9521a356-8a3c-45e8-ac23-576102734fc8-kube-api-access-xzf26\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.571318 master-0 kubenswrapper[4807]: I1014 13:37:15.571279 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-public-tls-certs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.571754 master-0 kubenswrapper[4807]: I1014 13:37:15.571687 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.571813 master-0 kubenswrapper[4807]: I1014 13:37:15.571767 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.572025 master-0 kubenswrapper[4807]: I1014 13:37:15.571960 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.572188 master-0 kubenswrapper[4807]: I1014 13:37:15.572146 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.572288 master-0 kubenswrapper[4807]: I1014 13:37:15.572262 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.638505 master-0 kubenswrapper[4807]: I1014 13:37:15.637949 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:15.638505 master-0 kubenswrapper[4807]: I1014 13:37:15.638115 4807 kubelet.go:2542] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674324 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674389 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674442 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674505 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674527 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674556 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xzf26\" (UniqueName: \"kubernetes.io/projected/9521a356-8a3c-45e8-ac23-576102734fc8-kube-api-access-xzf26\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.674831 master-0 kubenswrapper[4807]: I1014 13:37:15.674580 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-public-tls-certs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.675285 master-0 kubenswrapper[4807]: I1014 13:37:15.675028 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-logs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.675285 master-0 kubenswrapper[4807]: I1014 13:37:15.675108 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/9521a356-8a3c-45e8-ac23-576102734fc8-httpd-run\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.679228 master-0 kubenswrapper[4807]: I1014 13:37:15.678902 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-scripts\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.679228 master-0 kubenswrapper[4807]: I1014 13:37:15.679057 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-combined-ca-bundle\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.680260 master-0 kubenswrapper[4807]: I1014 13:37:15.680220 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-config-data\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.680707 master-0 kubenswrapper[4807]: I1014 13:37:15.680673 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/9521a356-8a3c-45e8-ac23-576102734fc8-public-tls-certs\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.759180 master-0 kubenswrapper[4807]: I1014 13:37:15.759107 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:15.796529 master-0 kubenswrapper[4807]: I1014 13:37:15.796432 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:15.882965 master-0 kubenswrapper[4807]: I1014 13:37:15.882574 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.888832 master-0 kubenswrapper[4807]: I1014 13:37:15.887253 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:37:15.888832 master-0 kubenswrapper[4807]: I1014 13:37:15.887305 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0946533a7a577b6cc932fda485e2d60110dea942f3391c26e217691a26212479/globalmount\"" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.908395 master-0 kubenswrapper[4807]: I1014 13:37:15.908307 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"31f8c441-8b98-4491-98fb-254ea7a94467","Type":"ContainerStarted","Data":"e183d7e639bc34e08b7ff63f2c36a0ef16338af826eb6540481fb367b7055cb9"} Oct 14 13:37:15.909591 master-0 kubenswrapper[4807]: I1014 13:37:15.909535 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzf26\" (UniqueName: \"kubernetes.io/projected/9521a356-8a3c-45e8-ac23-576102734fc8-kube-api-access-xzf26\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:15.912598 master-0 kubenswrapper[4807]: I1014 13:37:15.912518 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-66b7ffc58b-797f7" event={"ID":"b1784e65-d184-40d4-b81e-2203c0fa2007","Type":"ContainerStarted","Data":"6c78fbe1d1d52229e128462e9c41939f4d962de03de285a5703ca2691863c0f5"} Oct 14 13:37:15.912698 master-0 kubenswrapper[4807]: I1014 13:37:15.912606 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/ironic-66b7ffc58b-797f7" event={"ID":"b1784e65-d184-40d4-b81e-2203c0fa2007","Type":"ContainerStarted","Data":"29c78a8423daee4d0fdb482625d1b29b1e10b018428d2cd2dad27eef759d4846"} Oct 14 13:37:15.913685 master-0 kubenswrapper[4807]: I1014 13:37:15.913656 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:37:15.919361 master-0 kubenswrapper[4807]: I1014 13:37:15.919257 4807 generic.go:334] "Generic (PLEG): container finished" podID="eee60379-0b05-408a-9cea-54b9f2764937" containerID="188b57e368378eed7a69327702ae780cc55d9ae8d2531718808c9568a9366354" exitCode=1 Oct 14 13:37:15.919556 master-0 kubenswrapper[4807]: I1014 13:37:15.919322 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-689594cfbc-cxfsp" event={"ID":"eee60379-0b05-408a-9cea-54b9f2764937","Type":"ContainerDied","Data":"188b57e368378eed7a69327702ae780cc55d9ae8d2531718808c9568a9366354"} Oct 14 13:37:15.919556 master-0 kubenswrapper[4807]: I1014 13:37:15.919483 4807 scope.go:117] "RemoveContainer" containerID="cf9f5e9760b97eed019d602084a6bbda79039f569e7ee68cccd0f93b4c2ac253" Oct 14 13:37:15.920218 master-0 kubenswrapper[4807]: I1014 13:37:15.920176 4807 scope.go:117] "RemoveContainer" containerID="188b57e368378eed7a69327702ae780cc55d9ae8d2531718808c9568a9366354" Oct 14 13:37:15.920556 master-0 kubenswrapper[4807]: E1014 13:37:15.920464 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"heat-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=heat-api pod=heat-api-689594cfbc-cxfsp_openstack(eee60379-0b05-408a-9cea-54b9f2764937)\"" pod="openstack/heat-api-689594cfbc-cxfsp" podUID="eee60379-0b05-408a-9cea-54b9f2764937" Oct 14 13:37:15.927032 master-0 kubenswrapper[4807]: I1014 13:37:15.926983 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" event={"ID":"7f7543ce-015a-4f01-985f-b76efd804110","Type":"ContainerStarted","Data":"c497f27b692670dc81e454fb6ba9f048d3bdc5b40e321004c6547c108de6f88d"} Oct 14 13:37:15.927269 master-0 kubenswrapper[4807]: I1014 13:37:15.927243 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:15.960583 master-0 kubenswrapper[4807]: I1014 13:37:15.958944 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:15.962148 master-0 kubenswrapper[4807]: I1014 13:37:15.962106 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:15.964914 master-0 kubenswrapper[4807]: I1014 13:37:15.964810 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cinder-46645-volume-lvm-iscsi-config-data" Oct 14 13:37:15.965742 master-0 kubenswrapper[4807]: I1014 13:37:15.965679 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:16.056327 master-0 kubenswrapper[4807]: I1014 13:37:16.056241 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-db-create-4clwc"] Oct 14 13:37:16.058059 master-0 kubenswrapper[4807]: I1014 13:37:16.058006 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:16.071418 master-0 kubenswrapper[4807]: I1014 13:37:16.071316 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-4clwc"] Oct 14 13:37:16.089110 master-0 kubenswrapper[4807]: I1014 13:37:16.089010 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089309 master-0 kubenswrapper[4807]: I1014 13:37:16.089157 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089309 master-0 kubenswrapper[4807]: I1014 13:37:16.089215 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089309 master-0 kubenswrapper[4807]: I1014 13:37:16.089249 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089309 master-0 kubenswrapper[4807]: I1014 13:37:16.089281 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089487 master-0 kubenswrapper[4807]: I1014 13:37:16.089317 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089487 master-0 kubenswrapper[4807]: I1014 13:37:16.089400 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089487 master-0 kubenswrapper[4807]: I1014 13:37:16.089443 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089580 master-0 kubenswrapper[4807]: I1014 13:37:16.089494 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nf4g\" (UniqueName: \"kubernetes.io/projected/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-kube-api-access-6nf4g\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089580 master-0 kubenswrapper[4807]: I1014 13:37:16.089530 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089580 master-0 kubenswrapper[4807]: I1014 13:37:16.089566 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089669 master-0 kubenswrapper[4807]: I1014 13:37:16.089594 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089669 master-0 kubenswrapper[4807]: I1014 13:37:16.089631 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089669 master-0 kubenswrapper[4807]: I1014 13:37:16.089653 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.089751 master-0 kubenswrapper[4807]: I1014 13:37:16.089681 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.190857 master-0 kubenswrapper[4807]: I1014 13:37:16.190803 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.190978 master-0 kubenswrapper[4807]: I1014 13:37:16.190853 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191066 master-0 kubenswrapper[4807]: I1014 13:37:16.190984 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191066 master-0 kubenswrapper[4807]: I1014 13:37:16.190919 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-iscsi\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-iscsi\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191066 master-0 kubenswrapper[4807]: I1014 13:37:16.191045 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-sys\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191081 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191102 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-6nf4g\" (UniqueName: \"kubernetes.io/projected/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-kube-api-access-6nf4g\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191145 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191173 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191173 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-brick\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-brick\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.190924 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-run\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191242 master-0 kubenswrapper[4807]: I1014 13:37:16.191236 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-locks-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-locks-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191695 master-0 kubenswrapper[4807]: I1014 13:37:16.191266 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191695 master-0 kubenswrapper[4807]: I1014 13:37:16.191296 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191833 master-0 kubenswrapper[4807]: I1014 13:37:16.191780 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-lib-modules\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191901 master-0 kubenswrapper[4807]: I1014 13:37:16.191795 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.191982 master-0 kubenswrapper[4807]: I1014 13:37:16.191950 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192051 master-0 kubenswrapper[4807]: I1014 13:37:16.192003 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192120 master-0 kubenswrapper[4807]: I1014 13:37:16.192056 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdrc9\" (UniqueName: \"kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9\") pod \"nova-api-db-create-4clwc\" (UID: \"d8909ed0-31ec-436e-a543-d16ba5247cff\") " pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:16.192180 master-0 kubenswrapper[4807]: I1014 13:37:16.192100 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dev\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-dev\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192180 master-0 kubenswrapper[4807]: I1014 13:37:16.192132 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-nvme\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-nvme\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192378 master-0 kubenswrapper[4807]: I1014 13:37:16.192329 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192448 master-0 kubenswrapper[4807]: I1014 13:37:16.192435 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"var-lib-cinder\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-var-lib-cinder\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192570 master-0 kubenswrapper[4807]: I1014 13:37:16.192438 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192570 master-0 kubenswrapper[4807]: I1014 13:37:16.192484 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"etc-machine-id\" (UniqueName: \"kubernetes.io/host-path/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-etc-machine-id\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.192570 master-0 kubenswrapper[4807]: I1014 13:37:16.192503 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.194307 master-0 kubenswrapper[4807]: I1014 13:37:16.194260 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data-custom\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.198025 master-0 kubenswrapper[4807]: I1014 13:37:16.197980 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-scripts\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.198332 master-0 kubenswrapper[4807]: I1014 13:37:16.198290 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-combined-ca-bundle\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.199165 master-0 kubenswrapper[4807]: I1014 13:37:16.199120 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-config-data\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.277513 master-0 kubenswrapper[4807]: I1014 13:37:16.275929 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e4d4896-9b3d-4104-8c4a-0d85698d7850" path="/var/lib/kubelet/pods/8e4d4896-9b3d-4104-8c4a-0d85698d7850/volumes" Oct 14 13:37:16.277513 master-0 kubenswrapper[4807]: I1014 13:37:16.276957 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e5f9fd-a08d-463d-8954-e256e6d89efa" path="/var/lib/kubelet/pods/93e5f9fd-a08d-463d-8954-e256e6d89efa/volumes" Oct 14 13:37:16.296530 master-0 kubenswrapper[4807]: I1014 13:37:16.296086 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-xdrc9\" (UniqueName: \"kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9\") pod \"nova-api-db-create-4clwc\" (UID: \"d8909ed0-31ec-436e-a543-d16ba5247cff\") " pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:16.318217 master-0 kubenswrapper[4807]: I1014 13:37:16.318149 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdrc9\" (UniqueName: \"kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9\") pod \"nova-api-db-create-4clwc\" (UID: \"d8909ed0-31ec-436e-a543-d16ba5247cff\") " pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:16.377164 master-0 kubenswrapper[4807]: I1014 13:37:16.377069 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:16.446903 master-0 kubenswrapper[4807]: I1014 13:37:16.446810 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/cinder-46645-api-1" podUID="de8d4188-287e-4f7b-a774-098ca7e110fd" containerName="cinder-api" probeResult="failure" output="Get \"http://10.130.0.105:8776/healthcheck\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:37:16.456971 master-0 kubenswrapper[4807]: I1014 13:37:16.456650 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nf4g\" (UniqueName: \"kubernetes.io/projected/60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d-kube-api-access-6nf4g\") pod \"cinder-46645-volume-lvm-iscsi-0\" (UID: \"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d\") " pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.619574 master-0 kubenswrapper[4807]: I1014 13:37:16.619518 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:16.739826 master-0 kubenswrapper[4807]: I1014 13:37:16.739778 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-f08827e1-c2ac-418d-bf94-3501d5cec206\" (UniqueName: \"kubernetes.io/csi/topolvm.io^dbe9dc78-ffb4-4619-be6e-6b8951476601\") pod \"glance-46645-default-external-api-2\" (UID: \"9521a356-8a3c-45e8-ac23-576102734fc8\") " pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:16.950663 master-0 kubenswrapper[4807]: I1014 13:37:16.950597 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"31f8c441-8b98-4491-98fb-254ea7a94467","Type":"ContainerStarted","Data":"137ef0efb28cb8a86190f096421012d6f233f5b7d7d384c2a046dac3b7a688c5"} Oct 14 13:37:16.951293 master-0 kubenswrapper[4807]: I1014 13:37:16.950666 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-api-1" event={"ID":"31f8c441-8b98-4491-98fb-254ea7a94467","Type":"ContainerStarted","Data":"0ff987caa7cdc69c12c21496efdd23a503d219f5a3c4ff6d26b0be6d2e2c4665"} Oct 14 13:37:16.951293 master-0 kubenswrapper[4807]: I1014 13:37:16.950728 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/cinder-46645-api-1" Oct 14 13:37:16.953708 master-0 kubenswrapper[4807]: I1014 13:37:16.953689 4807 scope.go:117] "RemoveContainer" containerID="188b57e368378eed7a69327702ae780cc55d9ae8d2531718808c9568a9366354" Oct 14 13:37:16.957141 master-0 kubenswrapper[4807]: E1014 13:37:16.957054 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"heat-api\" with CrashLoopBackOff: \"back-off 10s restarting failed container=heat-api pod=heat-api-689594cfbc-cxfsp_openstack(eee60379-0b05-408a-9cea-54b9f2764937)\"" pod="openstack/heat-api-689594cfbc-cxfsp" podUID="eee60379-0b05-408a-9cea-54b9f2764937" Oct 14 13:37:16.969425 master-0 kubenswrapper[4807]: I1014 13:37:16.969317 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-4clwc" event={"ID":"d8909ed0-31ec-436e-a543-d16ba5247cff","Type":"ContainerStarted","Data":"417adbf460ffc9607edaeabac1fbf664142c846133b6c94623462cd8e86cdf84"} Oct 14 13:37:17.136811 master-0 kubenswrapper[4807]: I1014 13:37:17.136738 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-db-create-4clwc"] Oct 14 13:37:17.154541 master-0 kubenswrapper[4807]: I1014 13:37:17.154438 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:17.192678 master-0 kubenswrapper[4807]: I1014 13:37:17.192592 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:17.245066 master-0 kubenswrapper[4807]: I1014 13:37:17.234698 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/cinder-46645-volume-lvm-iscsi-0"] Oct 14 13:37:17.245066 master-0 kubenswrapper[4807]: I1014 13:37:17.238413 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:17.485565 master-0 kubenswrapper[4807]: I1014 13:37:17.485270 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:17.488433 master-0 kubenswrapper[4807]: I1014 13:37:17.487131 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.492974 master-0 kubenswrapper[4807]: I1014 13:37:17.492312 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-glance-default-internal-svc" Oct 14 13:37:17.493582 master-0 kubenswrapper[4807]: I1014 13:37:17.493418 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"glance-46645-default-internal-config-data" Oct 14 13:37:17.497143 master-0 kubenswrapper[4807]: I1014 13:37:17.497076 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:17.734830 master-0 kubenswrapper[4807]: I1014 13:37:17.734760 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8j9s\" (UniqueName: \"kubernetes.io/projected/e62704be-5b98-4a8c-885d-71522ee3ad26-kube-api-access-l8j9s\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.734830 master-0 kubenswrapper[4807]: I1014 13:37:17.734821 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.734844 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.734893 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.734945 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.734962 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.734997 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.735029 master-0 kubenswrapper[4807]: I1014 13:37:17.735027 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.814447 master-0 kubenswrapper[4807]: I1014 13:37:17.814204 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-cell0-db-create-sjlfx"] Oct 14 13:37:17.815524 master-0 kubenswrapper[4807]: I1014 13:37:17.815493 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:17.836815 master-0 kubenswrapper[4807]: I1014 13:37:17.836742 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-l8j9s\" (UniqueName: \"kubernetes.io/projected/e62704be-5b98-4a8c-885d-71522ee3ad26-kube-api-access-l8j9s\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.836815 master-0 kubenswrapper[4807]: I1014 13:37:17.836813 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.836849 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.836912 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.836989 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.837013 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.837061 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.837177 master-0 kubenswrapper[4807]: I1014 13:37:17.837104 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.838053 master-0 kubenswrapper[4807]: I1014 13:37:17.837994 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-logs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.838403 master-0 kubenswrapper[4807]: I1014 13:37:17.838111 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-run\" (UniqueName: \"kubernetes.io/empty-dir/e62704be-5b98-4a8c-885d-71522ee3ad26-httpd-run\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.839705 master-0 kubenswrapper[4807]: I1014 13:37:17.839666 4807 csi_attacher.go:380] kubernetes.io/csi: attacher.MountDevice STAGE_UNSTAGE_VOLUME capability not set. Skipping MountDevice... Oct 14 13:37:17.839788 master-0 kubenswrapper[4807]: I1014 13:37:17.839701 4807 operation_generator.go:580] "MountVolume.MountDevice succeeded for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") device mount path \"/var/lib/kubelet/plugins/kubernetes.io/csi/topolvm.io/0607fd0fd3d9e9ca937336483b9a0d8b1a65cee7b1ad65dcc6c16eec0f2d3d73/globalmount\"" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.842256 master-0 kubenswrapper[4807]: I1014 13:37:17.842201 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-internal-tls-certs\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.842563 master-0 kubenswrapper[4807]: I1014 13:37:17.842493 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-scripts\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.843817 master-0 kubenswrapper[4807]: I1014 13:37:17.843775 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-config-data\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.848402 master-0 kubenswrapper[4807]: I1014 13:37:17.848350 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e62704be-5b98-4a8c-885d-71522ee3ad26-combined-ca-bundle\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:17.938887 master-0 kubenswrapper[4807]: I1014 13:37:17.938833 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzl4c\" (UniqueName: \"kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c\") pod \"nova-cell0-db-create-sjlfx\" (UID: \"9c116711-616c-466d-89a2-0992401c40fa\") " pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:17.994435 master-0 kubenswrapper[4807]: I1014 13:37:17.994271 4807 generic.go:334] "Generic (PLEG): container finished" podID="d8909ed0-31ec-436e-a543-d16ba5247cff" containerID="073f21ef3c1b8e612442b3256183d8912a9cc074e4a7d53d12fc30c0dac4a738" exitCode=0 Oct 14 13:37:17.995074 master-0 kubenswrapper[4807]: I1014 13:37:17.994428 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-4clwc" event={"ID":"d8909ed0-31ec-436e-a543-d16ba5247cff","Type":"ContainerDied","Data":"073f21ef3c1b8e612442b3256183d8912a9cc074e4a7d53d12fc30c0dac4a738"} Oct 14 13:37:17.997256 master-0 kubenswrapper[4807]: I1014 13:37:17.997204 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d","Type":"ContainerStarted","Data":"a050a500f62285e77ed4b39ac53d0e9bce9a4ddc9ed0ec402a6a90c31827c9b3"} Oct 14 13:37:17.997321 master-0 kubenswrapper[4807]: I1014 13:37:17.997262 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d","Type":"ContainerStarted","Data":"838f5f23e17aed366b5d7dfdab77c73adfaadeb146cf00a53244ee86b16a924c"} Oct 14 13:37:17.997321 master-0 kubenswrapper[4807]: I1014 13:37:17.997294 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/cinder-46645-volume-lvm-iscsi-0" event={"ID":"60ee9c76-0f3b-4ccb-b4f3-ea2e4c20b92d","Type":"ContainerStarted","Data":"ec3282209ffb937c31a9a43b1a4daf2e1e9f6abc0c1322c0272c6695d6450d0b"} Oct 14 13:37:18.041801 master-0 kubenswrapper[4807]: I1014 13:37:18.041716 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rzl4c\" (UniqueName: \"kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c\") pod \"nova-cell0-db-create-sjlfx\" (UID: \"9c116711-616c-466d-89a2-0992401c40fa\") " pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:18.271778 master-0 kubenswrapper[4807]: I1014 13:37:18.271610 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16c0ea67-fb7f-4e96-9cc5-4da186d26c08" path="/var/lib/kubelet/pods/16c0ea67-fb7f-4e96-9cc5-4da186d26c08/volumes" Oct 14 13:37:18.593575 master-0 kubenswrapper[4807]: I1014 13:37:18.593185 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-sjlfx"] Oct 14 13:37:18.804682 master-0 kubenswrapper[4807]: I1014 13:37:18.804607 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8j9s\" (UniqueName: \"kubernetes.io/projected/e62704be-5b98-4a8c-885d-71522ee3ad26-kube-api-access-l8j9s\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:18.864824 master-0 kubenswrapper[4807]: I1014 13:37:18.864554 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"pvc-b255fe27-269c-4613-982c-72c563ea8ebd\" (UniqueName: \"kubernetes.io/csi/topolvm.io^c2973a57-c34d-46cd-b193-4d7780a4815f\") pod \"glance-46645-default-internal-api-2\" (UID: \"e62704be-5b98-4a8c-885d-71522ee3ad26\") " pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:18.990471 master-0 kubenswrapper[4807]: I1014 13:37:18.990376 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzl4c\" (UniqueName: \"kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c\") pod \"nova-cell0-db-create-sjlfx\" (UID: \"9c116711-616c-466d-89a2-0992401c40fa\") " pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:19.037207 master-0 kubenswrapper[4807]: I1014 13:37:19.034879 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:19.431137 master-0 kubenswrapper[4807]: I1014 13:37:19.431093 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:19.463877 master-0 kubenswrapper[4807]: I1014 13:37:19.460041 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" podStartSLOduration=11.460018423 podStartE2EDuration="11.460018423s" podCreationTimestamp="2025-10-14 13:37:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:18.787177599 +0000 UTC m=+1033.468479423" watchObservedRunningTime="2025-10-14 13:37:19.460018423 +0000 UTC m=+1034.141320247" Oct 14 13:37:19.463877 master-0 kubenswrapper[4807]: I1014 13:37:19.462018 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/ironic-66b7ffc58b-797f7" podStartSLOduration=23.38526239 podStartE2EDuration="34.462008497s" podCreationTimestamp="2025-10-14 13:36:45 +0000 UTC" firstStartedPulling="2025-10-14 13:37:02.180807503 +0000 UTC m=+1016.862109327" lastFinishedPulling="2025-10-14 13:37:13.25755362 +0000 UTC m=+1027.938855434" observedRunningTime="2025-10-14 13:37:19.456291031 +0000 UTC m=+1034.137592875" watchObservedRunningTime="2025-10-14 13:37:19.462008497 +0000 UTC m=+1034.143310321" Oct 14 13:37:19.577425 master-0 kubenswrapper[4807]: I1014 13:37:19.577342 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xdrc9\" (UniqueName: \"kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9\") pod \"d8909ed0-31ec-436e-a543-d16ba5247cff\" (UID: \"d8909ed0-31ec-436e-a543-d16ba5247cff\") " Oct 14 13:37:19.581399 master-0 kubenswrapper[4807]: I1014 13:37:19.581349 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9" (OuterVolumeSpecName: "kube-api-access-xdrc9") pod "d8909ed0-31ec-436e-a543-d16ba5247cff" (UID: "d8909ed0-31ec-436e-a543-d16ba5247cff"). InnerVolumeSpecName "kube-api-access-xdrc9". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:19.606446 master-0 kubenswrapper[4807]: I1014 13:37:19.606380 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:19.675264 master-0 kubenswrapper[4807]: I1014 13:37:19.675080 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-46645-api-1" podStartSLOduration=6.675048115 podStartE2EDuration="6.675048115s" podCreationTimestamp="2025-10-14 13:37:13 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:19.538761047 +0000 UTC m=+1034.220062871" watchObservedRunningTime="2025-10-14 13:37:19.675048115 +0000 UTC m=+1034.356349939" Oct 14 13:37:19.680267 master-0 kubenswrapper[4807]: I1014 13:37:19.680200 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-xdrc9\" (UniqueName: \"kubernetes.io/projected/d8909ed0-31ec-436e-a543-d16ba5247cff-kube-api-access-xdrc9\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:19.842569 master-0 kubenswrapper[4807]: I1014 13:37:19.842341 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-cell0-db-create-sjlfx"] Oct 14 13:37:19.976551 master-0 kubenswrapper[4807]: I1014 13:37:19.976478 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:20.028716 master-0 kubenswrapper[4807]: I1014 13:37:20.028638 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:37:20.055848 master-0 kubenswrapper[4807]: I1014 13:37:20.055766 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-sjlfx" event={"ID":"9c116711-616c-466d-89a2-0992401c40fa","Type":"ContainerStarted","Data":"8baf91635ad3bad8dab29eab17eb592a751043c8ee577b418ca645c0e9cdf3d9"} Oct 14 13:37:20.058948 master-0 kubenswrapper[4807]: I1014 13:37:20.058897 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-db-create-4clwc" event={"ID":"d8909ed0-31ec-436e-a543-d16ba5247cff","Type":"ContainerDied","Data":"417adbf460ffc9607edaeabac1fbf664142c846133b6c94623462cd8e86cdf84"} Oct 14 13:37:20.059064 master-0 kubenswrapper[4807]: I1014 13:37:20.058955 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="417adbf460ffc9607edaeabac1fbf664142c846133b6c94623462cd8e86cdf84" Oct 14 13:37:20.059105 master-0 kubenswrapper[4807]: I1014 13:37:20.059071 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-db-create-4clwc" Oct 14 13:37:20.352114 master-0 kubenswrapper[4807]: I1014 13:37:20.350446 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/cinder-46645-volume-lvm-iscsi-0" podStartSLOduration=5.350415148 podStartE2EDuration="5.350415148s" podCreationTimestamp="2025-10-14 13:37:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:20.32124434 +0000 UTC m=+1035.002546174" watchObservedRunningTime="2025-10-14 13:37:20.350415148 +0000 UTC m=+1035.031716972" Oct 14 13:37:20.423099 master-0 kubenswrapper[4807]: I1014 13:37:20.416212 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:20.501732 master-0 kubenswrapper[4807]: I1014 13:37:20.501660 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle\") pod \"eee60379-0b05-408a-9cea-54b9f2764937\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " Oct 14 13:37:20.501893 master-0 kubenswrapper[4807]: I1014 13:37:20.501771 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g9p8x\" (UniqueName: \"kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x\") pod \"eee60379-0b05-408a-9cea-54b9f2764937\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " Oct 14 13:37:20.501893 master-0 kubenswrapper[4807]: I1014 13:37:20.501812 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data\") pod \"eee60379-0b05-408a-9cea-54b9f2764937\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " Oct 14 13:37:20.502042 master-0 kubenswrapper[4807]: I1014 13:37:20.501915 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom\") pod \"eee60379-0b05-408a-9cea-54b9f2764937\" (UID: \"eee60379-0b05-408a-9cea-54b9f2764937\") " Oct 14 13:37:20.507799 master-0 kubenswrapper[4807]: I1014 13:37:20.507728 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x" (OuterVolumeSpecName: "kube-api-access-g9p8x") pod "eee60379-0b05-408a-9cea-54b9f2764937" (UID: "eee60379-0b05-408a-9cea-54b9f2764937"). InnerVolumeSpecName "kube-api-access-g9p8x". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:20.520002 master-0 kubenswrapper[4807]: I1014 13:37:20.519916 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "eee60379-0b05-408a-9cea-54b9f2764937" (UID: "eee60379-0b05-408a-9cea-54b9f2764937"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:20.530582 master-0 kubenswrapper[4807]: I1014 13:37:20.530500 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "eee60379-0b05-408a-9cea-54b9f2764937" (UID: "eee60379-0b05-408a-9cea-54b9f2764937"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:20.560691 master-0 kubenswrapper[4807]: W1014 13:37:20.560610 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9521a356_8a3c_45e8_ac23_576102734fc8.slice/crio-e4cefd12da4d30c732beb61c4d8570cdd063e886e26acea6d6149b3661d5ea71 WatchSource:0}: Error finding container e4cefd12da4d30c732beb61c4d8570cdd063e886e26acea6d6149b3661d5ea71: Status 404 returned error can't find the container with id e4cefd12da4d30c732beb61c4d8570cdd063e886e26acea6d6149b3661d5ea71 Oct 14 13:37:20.562366 master-0 kubenswrapper[4807]: I1014 13:37:20.562330 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data" (OuterVolumeSpecName: "config-data") pod "eee60379-0b05-408a-9cea-54b9f2764937" (UID: "eee60379-0b05-408a-9cea-54b9f2764937"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:37:20.565533 master-0 kubenswrapper[4807]: I1014 13:37:20.565285 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-external-api-2"] Oct 14 13:37:20.604903 master-0 kubenswrapper[4807]: I1014 13:37:20.604836 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:20.604903 master-0 kubenswrapper[4807]: I1014 13:37:20.604895 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-g9p8x\" (UniqueName: \"kubernetes.io/projected/eee60379-0b05-408a-9cea-54b9f2764937-kube-api-access-g9p8x\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:20.604903 master-0 kubenswrapper[4807]: I1014 13:37:20.604910 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:20.605091 master-0 kubenswrapper[4807]: I1014 13:37:20.604924 4807 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/eee60379-0b05-408a-9cea-54b9f2764937-config-data-custom\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:21.069314 master-0 kubenswrapper[4807]: I1014 13:37:21.069257 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-sjlfx" event={"ID":"9c116711-616c-466d-89a2-0992401c40fa","Type":"ContainerDied","Data":"27d26353591f9565f1ce4af139c457333d27a4789858be9255609e3d21bace8d"} Oct 14 13:37:21.069853 master-0 kubenswrapper[4807]: I1014 13:37:21.068934 4807 generic.go:334] "Generic (PLEG): container finished" podID="9c116711-616c-466d-89a2-0992401c40fa" containerID="27d26353591f9565f1ce4af139c457333d27a4789858be9255609e3d21bace8d" exitCode=0 Oct 14 13:37:21.073931 master-0 kubenswrapper[4807]: I1014 13:37:21.072526 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-689594cfbc-cxfsp" event={"ID":"eee60379-0b05-408a-9cea-54b9f2764937","Type":"ContainerDied","Data":"f2be044cf9a34e050b3fe475ade5b0f07930690da11d8dc36960bde81bd5c2b8"} Oct 14 13:37:21.073931 master-0 kubenswrapper[4807]: I1014 13:37:21.072583 4807 scope.go:117] "RemoveContainer" containerID="188b57e368378eed7a69327702ae780cc55d9ae8d2531718808c9568a9366354" Oct 14 13:37:21.073931 master-0 kubenswrapper[4807]: I1014 13:37:21.072731 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-689594cfbc-cxfsp" Oct 14 13:37:21.089242 master-0 kubenswrapper[4807]: I1014 13:37:21.089076 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"9521a356-8a3c-45e8-ac23-576102734fc8","Type":"ContainerStarted","Data":"e4cefd12da4d30c732beb61c4d8570cdd063e886e26acea6d6149b3661d5ea71"} Oct 14 13:37:21.619791 master-0 kubenswrapper[4807]: I1014 13:37:21.619702 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:21.972605 master-0 kubenswrapper[4807]: I1014 13:37:21.972534 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:21.983435 master-0 kubenswrapper[4807]: I1014 13:37:21.983374 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/heat-api-689594cfbc-cxfsp"] Oct 14 13:37:22.106750 master-0 kubenswrapper[4807]: I1014 13:37:22.106676 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"9521a356-8a3c-45e8-ac23-576102734fc8","Type":"ContainerStarted","Data":"84a6393f305c1c780aa1ea3bdee5fde5083a213167dc81e9eb1b90dc36e519bc"} Oct 14 13:37:22.305388 master-0 kubenswrapper[4807]: I1014 13:37:22.278104 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eee60379-0b05-408a-9cea-54b9f2764937" path="/var/lib/kubelet/pods/eee60379-0b05-408a-9cea-54b9f2764937/volumes" Oct 14 13:37:22.591674 master-0 kubenswrapper[4807]: I1014 13:37:22.591329 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:22.650669 master-0 kubenswrapper[4807]: I1014 13:37:22.650601 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rzl4c\" (UniqueName: \"kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c\") pod \"9c116711-616c-466d-89a2-0992401c40fa\" (UID: \"9c116711-616c-466d-89a2-0992401c40fa\") " Oct 14 13:37:22.654135 master-0 kubenswrapper[4807]: I1014 13:37:22.654048 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c" (OuterVolumeSpecName: "kube-api-access-rzl4c") pod "9c116711-616c-466d-89a2-0992401c40fa" (UID: "9c116711-616c-466d-89a2-0992401c40fa"). InnerVolumeSpecName "kube-api-access-rzl4c". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:37:22.711048 master-0 kubenswrapper[4807]: I1014 13:37:22.710950 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/ironic-66b7ffc58b-797f7" Oct 14 13:37:22.753726 master-0 kubenswrapper[4807]: I1014 13:37:22.753642 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-rzl4c\" (UniqueName: \"kubernetes.io/projected/9c116711-616c-466d-89a2-0992401c40fa-kube-api-access-rzl4c\") on node \"master-0\" DevicePath \"\"" Oct 14 13:37:23.086067 master-0 kubenswrapper[4807]: I1014 13:37:23.085996 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/glance-46645-default-internal-api-2"] Oct 14 13:37:23.129167 master-0 kubenswrapper[4807]: I1014 13:37:23.129101 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-cell0-db-create-sjlfx" Oct 14 13:37:23.129718 master-0 kubenswrapper[4807]: I1014 13:37:23.129090 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-cell0-db-create-sjlfx" event={"ID":"9c116711-616c-466d-89a2-0992401c40fa","Type":"ContainerDied","Data":"8baf91635ad3bad8dab29eab17eb592a751043c8ee577b418ca645c0e9cdf3d9"} Oct 14 13:37:23.129718 master-0 kubenswrapper[4807]: I1014 13:37:23.129269 4807 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8baf91635ad3bad8dab29eab17eb592a751043c8ee577b418ca645c0e9cdf3d9" Oct 14 13:37:23.135568 master-0 kubenswrapper[4807]: I1014 13:37:23.135527 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"e62704be-5b98-4a8c-885d-71522ee3ad26","Type":"ContainerStarted","Data":"b9697ba03ce1b802ec9f9bde30b829cfe7ff8ff40bdb6dee90b5590da549c15e"} Oct 14 13:37:23.144969 master-0 kubenswrapper[4807]: I1014 13:37:23.144898 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-external-api-2" event={"ID":"9521a356-8a3c-45e8-ac23-576102734fc8","Type":"ContainerStarted","Data":"7d6b73751152a393b5d8eddf0f0113dd7aa9b0847453e3f23e137faaaf9b3210"} Oct 14 13:37:23.319056 master-0 kubenswrapper[4807]: I1014 13:37:23.318854 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-46645-default-external-api-2" podStartSLOduration=9.318828871000001 podStartE2EDuration="9.318828871s" podCreationTimestamp="2025-10-14 13:37:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:23.316895908 +0000 UTC m=+1037.998197732" watchObservedRunningTime="2025-10-14 13:37:23.318828871 +0000 UTC m=+1038.000130695" Oct 14 13:37:24.159335 master-0 kubenswrapper[4807]: I1014 13:37:24.159251 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"e62704be-5b98-4a8c-885d-71522ee3ad26","Type":"ContainerStarted","Data":"8886eee316c7fa53025ada75e3b922935a125edd9ce33d4e354c97cd635b496d"} Oct 14 13:37:24.257820 master-0 kubenswrapper[4807]: I1014 13:37:24.257765 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:37:25.177597 master-0 kubenswrapper[4807]: I1014 13:37:25.177265 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/glance-46645-default-internal-api-2" event={"ID":"e62704be-5b98-4a8c-885d-71522ee3ad26","Type":"ContainerStarted","Data":"21d82e857ec910c5ca06522ec49729539313eb4c24201d5be033a3e873f62138"} Oct 14 13:37:25.254730 master-0 kubenswrapper[4807]: I1014 13:37:25.254626 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/glance-46645-default-internal-api-2" podStartSLOduration=8.254605349 podStartE2EDuration="8.254605349s" podCreationTimestamp="2025-10-14 13:37:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:25.253643383 +0000 UTC m=+1039.934945227" watchObservedRunningTime="2025-10-14 13:37:25.254605349 +0000 UTC m=+1039.935907163" Oct 14 13:37:26.933410 master-0 kubenswrapper[4807]: I1014 13:37:26.933316 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/cinder-46645-volume-lvm-iscsi-0" Oct 14 13:37:26.981808 master-0 kubenswrapper[4807]: I1014 13:37:26.981682 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/cinder-46645-api-1" Oct 14 13:37:27.239503 master-0 kubenswrapper[4807]: I1014 13:37:27.239419 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:27.239503 master-0 kubenswrapper[4807]: I1014 13:37:27.239509 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:27.278007 master-0 kubenswrapper[4807]: I1014 13:37:27.275763 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:27.300211 master-0 kubenswrapper[4807]: I1014 13:37:27.300136 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:28.228236 master-0 kubenswrapper[4807]: I1014 13:37:28.228156 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:28.228236 master-0 kubenswrapper[4807]: I1014 13:37:28.228220 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:29.607848 master-0 kubenswrapper[4807]: I1014 13:37:29.607739 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:29.607848 master-0 kubenswrapper[4807]: I1014 13:37:29.607846 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:29.638849 master-0 kubenswrapper[4807]: I1014 13:37:29.638087 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:29.648670 master-0 kubenswrapper[4807]: I1014 13:37:29.648611 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:30.253082 master-0 kubenswrapper[4807]: I1014 13:37:30.252886 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:30.253082 master-0 kubenswrapper[4807]: I1014 13:37:30.252967 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:30.384141 master-0 kubenswrapper[4807]: I1014 13:37:30.384059 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:30.384343 master-0 kubenswrapper[4807]: I1014 13:37:30.384263 4807 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Oct 14 13:37:30.422598 master-0 kubenswrapper[4807]: I1014 13:37:30.422529 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-46645-default-external-api-2" Oct 14 13:37:32.359051 master-0 kubenswrapper[4807]: I1014 13:37:32.358984 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:32.359697 master-0 kubenswrapper[4807]: I1014 13:37:32.359267 4807 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Oct 14 13:37:32.430988 master-0 kubenswrapper[4807]: I1014 13:37:32.430920 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/glance-46645-default-internal-api-2" Oct 14 13:37:44.065928 master-0 kubenswrapper[4807]: I1014 13:37:44.065866 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/neutron-57bb6bd49-fl8n6"] Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: E1014 13:37:44.066279 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066295 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: E1014 13:37:44.066304 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d8909ed0-31ec-436e-a543-d16ba5247cff" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066310 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8909ed0-31ec-436e-a543-d16ba5247cff" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: E1014 13:37:44.066346 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="9c116711-616c-466d-89a2-0992401c40fa" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066353 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c116711-616c-466d-89a2-0992401c40fa" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066636 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066649 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="9c116711-616c-466d-89a2-0992401c40fa" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066663 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="d8909ed0-31ec-436e-a543-d16ba5247cff" containerName="mariadb-database-create" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066671 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: E1014 13:37:44.066797 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.066804 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="eee60379-0b05-408a-9cea-54b9f2764937" containerName="heat-api" Oct 14 13:37:44.067791 master-0 kubenswrapper[4807]: I1014 13:37:44.067715 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.071807 master-0 kubenswrapper[4807]: I1014 13:37:44.071750 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-internal-svc" Oct 14 13:37:44.072423 master-0 kubenswrapper[4807]: I1014 13:37:44.072378 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-neutron-public-svc" Oct 14 13:37:44.090936 master-0 kubenswrapper[4807]: I1014 13:37:44.090494 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-57bb6bd49-fl8n6"] Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193493 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-ovndb-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193565 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-httpd-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193583 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-internal-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193656 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-public-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193689 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-combined-ca-bundle\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193712 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.194063 master-0 kubenswrapper[4807]: I1014 13:37:44.193811 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtkhv\" (UniqueName: \"kubernetes.io/projected/8439ebb4-6670-419c-8fb6-8772c3e44b3f-kube-api-access-rtkhv\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.297900 master-0 kubenswrapper[4807]: I1014 13:37:44.297038 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-public-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.297900 master-0 kubenswrapper[4807]: I1014 13:37:44.297702 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-combined-ca-bundle\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.298607 master-0 kubenswrapper[4807]: I1014 13:37:44.298497 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.299037 master-0 kubenswrapper[4807]: I1014 13:37:44.298958 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-rtkhv\" (UniqueName: \"kubernetes.io/projected/8439ebb4-6670-419c-8fb6-8772c3e44b3f-kube-api-access-rtkhv\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.300774 master-0 kubenswrapper[4807]: I1014 13:37:44.299511 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-ovndb-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.300774 master-0 kubenswrapper[4807]: I1014 13:37:44.299564 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-internal-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.300774 master-0 kubenswrapper[4807]: I1014 13:37:44.299594 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-httpd-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.303569 master-0 kubenswrapper[4807]: I1014 13:37:44.303475 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-public-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.304198 master-0 kubenswrapper[4807]: I1014 13:37:44.304052 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-ovndb-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.304198 master-0 kubenswrapper[4807]: I1014 13:37:44.304121 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-httpd-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.304361 master-0 kubenswrapper[4807]: I1014 13:37:44.304294 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-internal-tls-certs\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.305520 master-0 kubenswrapper[4807]: I1014 13:37:44.304651 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-combined-ca-bundle\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.305520 master-0 kubenswrapper[4807]: I1014 13:37:44.305147 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8439ebb4-6670-419c-8fb6-8772c3e44b3f-config\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.343342 master-0 kubenswrapper[4807]: I1014 13:37:44.343262 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtkhv\" (UniqueName: \"kubernetes.io/projected/8439ebb4-6670-419c-8fb6-8772c3e44b3f-kube-api-access-rtkhv\") pod \"neutron-57bb6bd49-fl8n6\" (UID: \"8439ebb4-6670-419c-8fb6-8772c3e44b3f\") " pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:44.399548 master-0 kubenswrapper[4807]: I1014 13:37:44.398033 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:45.673497 master-0 kubenswrapper[4807]: I1014 13:37:45.673409 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/neutron-57bb6bd49-fl8n6"] Oct 14 13:37:46.470973 master-0 kubenswrapper[4807]: I1014 13:37:46.470800 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-57bb6bd49-fl8n6" event={"ID":"8439ebb4-6670-419c-8fb6-8772c3e44b3f","Type":"ContainerStarted","Data":"7a684bdad971a667a2f2197e1acafb91db0388cb2094314bc2fd0ff3e37bfeb0"} Oct 14 13:37:46.470973 master-0 kubenswrapper[4807]: I1014 13:37:46.470881 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-57bb6bd49-fl8n6" event={"ID":"8439ebb4-6670-419c-8fb6-8772c3e44b3f","Type":"ContainerStarted","Data":"c69151475af07c132429c0fc0a573b10d894e5fb0262099a587384c6f2b061fe"} Oct 14 13:37:46.470973 master-0 kubenswrapper[4807]: I1014 13:37:46.470898 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-57bb6bd49-fl8n6" event={"ID":"8439ebb4-6670-419c-8fb6-8772c3e44b3f","Type":"ContainerStarted","Data":"6115e122e8ca3e9e4df3d645972ff6da461c5c9ce43eeeedf29a742b8442004e"} Oct 14 13:37:46.471289 master-0 kubenswrapper[4807]: I1014 13:37:46.471047 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:37:46.515118 master-0 kubenswrapper[4807]: I1014 13:37:46.513932 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/neutron-57bb6bd49-fl8n6" podStartSLOduration=2.5138967340000002 podStartE2EDuration="2.513896734s" podCreationTimestamp="2025-10-14 13:37:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:37:46.499313565 +0000 UTC m=+1061.180615399" watchObservedRunningTime="2025-10-14 13:37:46.513896734 +0000 UTC m=+1061.195198558" Oct 14 13:38:14.422516 master-0 kubenswrapper[4807]: I1014 13:38:14.419945 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/neutron-57bb6bd49-fl8n6" Oct 14 13:38:14.497442 master-0 kubenswrapper[4807]: I1014 13:38:14.497364 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:38:14.519123 master-0 kubenswrapper[4807]: I1014 13:38:14.514400 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom\") pod \"09349de8-6a79-43e8-9676-0483fb702a86\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " Oct 14 13:38:14.519123 master-0 kubenswrapper[4807]: I1014 13:38:14.514529 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5pvt\" (UniqueName: \"kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt\") pod \"09349de8-6a79-43e8-9676-0483fb702a86\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " Oct 14 13:38:14.519123 master-0 kubenswrapper[4807]: I1014 13:38:14.514588 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data\") pod \"09349de8-6a79-43e8-9676-0483fb702a86\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " Oct 14 13:38:14.519123 master-0 kubenswrapper[4807]: I1014 13:38:14.514627 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle\") pod \"09349de8-6a79-43e8-9676-0483fb702a86\" (UID: \"09349de8-6a79-43e8-9676-0483fb702a86\") " Oct 14 13:38:14.520025 master-0 kubenswrapper[4807]: I1014 13:38:14.519958 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom" (OuterVolumeSpecName: "config-data-custom") pod "09349de8-6a79-43e8-9676-0483fb702a86" (UID: "09349de8-6a79-43e8-9676-0483fb702a86"). InnerVolumeSpecName "config-data-custom". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:14.520816 master-0 kubenswrapper[4807]: I1014 13:38:14.520750 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt" (OuterVolumeSpecName: "kube-api-access-h5pvt") pod "09349de8-6a79-43e8-9676-0483fb702a86" (UID: "09349de8-6a79-43e8-9676-0483fb702a86"). InnerVolumeSpecName "kube-api-access-h5pvt". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:14.530688 master-0 kubenswrapper[4807]: I1014 13:38:14.530613 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:38:14.531494 master-0 kubenswrapper[4807]: I1014 13:38:14.531038 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-55c4fcb4cb-sszff" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-httpd" containerID="cri-o://eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c" gracePeriod=30 Oct 14 13:38:14.534513 master-0 kubenswrapper[4807]: I1014 13:38:14.533877 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/neutron-55c4fcb4cb-sszff" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-api" containerID="cri-o://ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd" gracePeriod=30 Oct 14 13:38:14.554644 master-0 kubenswrapper[4807]: I1014 13:38:14.554557 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "09349de8-6a79-43e8-9676-0483fb702a86" (UID: "09349de8-6a79-43e8-9676-0483fb702a86"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:14.566294 master-0 kubenswrapper[4807]: I1014 13:38:14.566039 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data" (OuterVolumeSpecName: "config-data") pod "09349de8-6a79-43e8-9676-0483fb702a86" (UID: "09349de8-6a79-43e8-9676-0483fb702a86"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:14.624484 master-0 kubenswrapper[4807]: I1014 13:38:14.622080 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:14.624484 master-0 kubenswrapper[4807]: I1014 13:38:14.622139 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:14.624484 master-0 kubenswrapper[4807]: I1014 13:38:14.622155 4807 reconciler_common.go:293] "Volume detached for volume \"config-data-custom\" (UniqueName: \"kubernetes.io/secret/09349de8-6a79-43e8-9676-0483fb702a86-config-data-custom\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:14.624484 master-0 kubenswrapper[4807]: I1014 13:38:14.622170 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-h5pvt\" (UniqueName: \"kubernetes.io/projected/09349de8-6a79-43e8-9676-0483fb702a86-kube-api-access-h5pvt\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:14.808911 master-0 kubenswrapper[4807]: I1014 13:38:14.808847 4807 generic.go:334] "Generic (PLEG): container finished" podID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerID="eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c" exitCode=0 Oct 14 13:38:14.809325 master-0 kubenswrapper[4807]: I1014 13:38:14.808953 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerDied","Data":"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c"} Oct 14 13:38:14.810815 master-0 kubenswrapper[4807]: I1014 13:38:14.810789 4807 generic.go:334] "Generic (PLEG): container finished" podID="09349de8-6a79-43e8-9676-0483fb702a86" containerID="d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e" exitCode=137 Oct 14 13:38:14.810894 master-0 kubenswrapper[4807]: I1014 13:38:14.810833 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-6875d55546-w7958" event={"ID":"09349de8-6a79-43e8-9676-0483fb702a86","Type":"ContainerDied","Data":"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e"} Oct 14 13:38:14.810894 master-0 kubenswrapper[4807]: I1014 13:38:14.810876 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/heat-api-6875d55546-w7958" Oct 14 13:38:14.810966 master-0 kubenswrapper[4807]: I1014 13:38:14.810899 4807 scope.go:117] "RemoveContainer" containerID="d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e" Oct 14 13:38:14.811042 master-0 kubenswrapper[4807]: I1014 13:38:14.810881 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/heat-api-6875d55546-w7958" event={"ID":"09349de8-6a79-43e8-9676-0483fb702a86","Type":"ContainerDied","Data":"f15a2eed506b48cb2d4b6491a74cc44bddb7eaff3311617856aced5d246ac596"} Oct 14 13:38:14.829925 master-0 kubenswrapper[4807]: I1014 13:38:14.829801 4807 scope.go:117] "RemoveContainer" containerID="d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e" Oct 14 13:38:14.830583 master-0 kubenswrapper[4807]: E1014 13:38:14.830527 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e\": container with ID starting with d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e not found: ID does not exist" containerID="d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e" Oct 14 13:38:14.830642 master-0 kubenswrapper[4807]: I1014 13:38:14.830573 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e"} err="failed to get container status \"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e\": rpc error: code = NotFound desc = could not find container \"d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e\": container with ID starting with d07952c7001601b5e2f61bee12e5645ba0f6438b77b2076552b473c1e4538c8e not found: ID does not exist" Oct 14 13:38:14.868999 master-0 kubenswrapper[4807]: I1014 13:38:14.868882 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:38:14.879750 master-0 kubenswrapper[4807]: I1014 13:38:14.879653 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/heat-api-6875d55546-w7958"] Oct 14 13:38:16.358857 master-0 kubenswrapper[4807]: I1014 13:38:16.358613 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09349de8-6a79-43e8-9676-0483fb702a86" path="/var/lib/kubelet/pods/09349de8-6a79-43e8-9676-0483fb702a86/volumes" Oct 14 13:38:22.298313 master-0 kubenswrapper[4807]: I1014 13:38:22.298149 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-1"] Oct 14 13:38:22.299055 master-0 kubenswrapper[4807]: E1014 13:38:22.298857 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="09349de8-6a79-43e8-9676-0483fb702a86" containerName="heat-api" Oct 14 13:38:22.299055 master-0 kubenswrapper[4807]: I1014 13:38:22.298883 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="09349de8-6a79-43e8-9676-0483fb702a86" containerName="heat-api" Oct 14 13:38:22.299265 master-0 kubenswrapper[4807]: I1014 13:38:22.299082 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="09349de8-6a79-43e8-9676-0483fb702a86" containerName="heat-api" Oct 14 13:38:22.300304 master-0 kubenswrapper[4807]: I1014 13:38:22.300268 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:38:22.303615 master-0 kubenswrapper[4807]: I1014 13:38:22.303571 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Oct 14 13:38:22.321578 master-0 kubenswrapper[4807]: I1014 13:38:22.321524 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:38:22.365902 master-0 kubenswrapper[4807]: I1014 13:38:22.365827 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn667\" (UniqueName: \"kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.366921 master-0 kubenswrapper[4807]: I1014 13:38:22.366889 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.367068 master-0 kubenswrapper[4807]: I1014 13:38:22.367049 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.367234 master-0 kubenswrapper[4807]: I1014 13:38:22.367220 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.400193 master-0 kubenswrapper[4807]: I1014 13:38:22.400091 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:22.402848 master-0 kubenswrapper[4807]: I1014 13:38:22.402801 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:22.412063 master-0 kubenswrapper[4807]: I1014 13:38:22.411987 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Oct 14 13:38:22.420948 master-0 kubenswrapper[4807]: I1014 13:38:22.420885 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:22.469423 master-0 kubenswrapper[4807]: I1014 13:38:22.469320 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.469715 master-0 kubenswrapper[4807]: I1014 13:38:22.469639 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.469715 master-0 kubenswrapper[4807]: I1014 13:38:22.469688 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.469788 master-0 kubenswrapper[4807]: I1014 13:38:22.469744 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tfz\" (UniqueName: \"kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.469822 master-0 kubenswrapper[4807]: I1014 13:38:22.469801 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.469895 master-0 kubenswrapper[4807]: I1014 13:38:22.469849 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-sn667\" (UniqueName: \"kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.469932 master-0 kubenswrapper[4807]: I1014 13:38:22.469919 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.470815 master-0 kubenswrapper[4807]: I1014 13:38:22.470623 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.474725 master-0 kubenswrapper[4807]: I1014 13:38:22.474660 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.481555 master-0 kubenswrapper[4807]: I1014 13:38:22.481451 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.494263 master-0 kubenswrapper[4807]: I1014 13:38:22.493759 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn667\" (UniqueName: \"kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667\") pod \"nova-api-1\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " pod="openstack/nova-api-1" Oct 14 13:38:22.573018 master-0 kubenswrapper[4807]: I1014 13:38:22.572817 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.573018 master-0 kubenswrapper[4807]: I1014 13:38:22.572944 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.573374 master-0 kubenswrapper[4807]: I1014 13:38:22.573197 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tfz\" (UniqueName: \"kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.577344 master-0 kubenswrapper[4807]: I1014 13:38:22.577270 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.577775 master-0 kubenswrapper[4807]: I1014 13:38:22.577736 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.618679 master-0 kubenswrapper[4807]: I1014 13:38:22.618576 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:38:22.667263 master-0 kubenswrapper[4807]: I1014 13:38:22.667199 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tfz\" (UniqueName: \"kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz\") pod \"nova-scheduler-2\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:22.737574 master-0 kubenswrapper[4807]: I1014 13:38:22.735023 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:22.770105 master-0 kubenswrapper[4807]: I1014 13:38:22.770033 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:22.771775 master-0 kubenswrapper[4807]: I1014 13:38:22.771731 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:22.801378 master-0 kubenswrapper[4807]: I1014 13:38:22.789203 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Oct 14 13:38:22.822197 master-0 kubenswrapper[4807]: I1014 13:38:22.820877 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:22.893335 master-0 kubenswrapper[4807]: I1014 13:38:22.893237 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:22.893335 master-0 kubenswrapper[4807]: I1014 13:38:22.893343 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:22.893688 master-0 kubenswrapper[4807]: I1014 13:38:22.893372 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tstbg\" (UniqueName: \"kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:22.893688 master-0 kubenswrapper[4807]: I1014 13:38:22.893433 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.000147 master-0 kubenswrapper[4807]: I1014 13:38:23.000080 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.000403 master-0 kubenswrapper[4807]: I1014 13:38:23.000377 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.000594 master-0 kubenswrapper[4807]: I1014 13:38:23.000575 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.000671 master-0 kubenswrapper[4807]: I1014 13:38:23.000645 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-tstbg\" (UniqueName: \"kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.001315 master-0 kubenswrapper[4807]: I1014 13:38:23.001226 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.006197 master-0 kubenswrapper[4807]: I1014 13:38:23.006149 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.010121 master-0 kubenswrapper[4807]: I1014 13:38:23.006241 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.027690 master-0 kubenswrapper[4807]: I1014 13:38:23.027637 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-tstbg\" (UniqueName: \"kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg\") pod \"nova-metadata-2\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " pod="openstack/nova-metadata-2" Oct 14 13:38:23.117558 master-0 kubenswrapper[4807]: I1014 13:38:23.111678 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:23.162764 master-0 kubenswrapper[4807]: I1014 13:38:23.158066 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:38:23.282313 master-0 kubenswrapper[4807]: W1014 13:38:23.282251 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc2929482_e230_4e66_a326_f0de1561be36.slice/crio-f434442579ac2c07399a166567f5790ad955616c215e32fa1b0f83d3cbd72d46 WatchSource:0}: Error finding container f434442579ac2c07399a166567f5790ad955616c215e32fa1b0f83d3cbd72d46: Status 404 returned error can't find the container with id f434442579ac2c07399a166567f5790ad955616c215e32fa1b0f83d3cbd72d46 Oct 14 13:38:23.285664 master-0 kubenswrapper[4807]: I1014 13:38:23.285587 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:23.563560 master-0 kubenswrapper[4807]: I1014 13:38:23.563486 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:23.926614 master-0 kubenswrapper[4807]: I1014 13:38:23.926546 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerStarted","Data":"7f837f3e4c5cdc6bdc9212460719e7063d3a30174aecb9a1703e79a4867764d0"} Oct 14 13:38:23.930254 master-0 kubenswrapper[4807]: I1014 13:38:23.930217 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerStarted","Data":"0de560c5756109da3c5b4331421a42ddf5aaf3e5c2adf794c466de224669d6e0"} Oct 14 13:38:23.932296 master-0 kubenswrapper[4807]: I1014 13:38:23.932261 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"c2929482-e230-4e66-a326-f0de1561be36","Type":"ContainerStarted","Data":"f434442579ac2c07399a166567f5790ad955616c215e32fa1b0f83d3cbd72d46"} Oct 14 13:38:25.903383 master-0 kubenswrapper[4807]: I1014 13:38:25.902998 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:26.923448 master-0 kubenswrapper[4807]: I1014 13:38:26.923304 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/neutron-55c4fcb4cb-sszff" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-httpd" probeResult="failure" output="Get \"http://10.130.0.101:9696/\": dial tcp 10.130.0.101:9696: connect: connection refused" Oct 14 13:38:31.828934 master-0 kubenswrapper[4807]: E1014 13:38:31.827682 4807 cadvisor_stats_provider.go:516] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34c3d910_7aca_4f4e_9129_28794dee1163.slice/crio-4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416.scope\": RecentStats: unable to find data in memory cache]" Oct 14 13:38:32.030155 master-0 kubenswrapper[4807]: I1014 13:38:32.027264 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"c2929482-e230-4e66-a326-f0de1561be36","Type":"ContainerStarted","Data":"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f"} Oct 14 13:38:32.030155 master-0 kubenswrapper[4807]: I1014 13:38:32.029853 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerStarted","Data":"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416"} Oct 14 13:38:32.033636 master-0 kubenswrapper[4807]: I1014 13:38:32.033374 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerStarted","Data":"fd3d2986d5003596a60e30f6b335a1985525936e39c1ba8950d48e91dc164b4a"} Oct 14 13:38:32.059843 master-0 kubenswrapper[4807]: I1014 13:38:32.059403 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-2" podStartSLOduration=1.7555796369999999 podStartE2EDuration="10.059374379s" podCreationTimestamp="2025-10-14 13:38:22 +0000 UTC" firstStartedPulling="2025-10-14 13:38:23.286751805 +0000 UTC m=+1097.968053629" lastFinishedPulling="2025-10-14 13:38:31.590546547 +0000 UTC m=+1106.271848371" observedRunningTime="2025-10-14 13:38:32.05355909 +0000 UTC m=+1106.734860924" watchObservedRunningTime="2025-10-14 13:38:32.059374379 +0000 UTC m=+1106.740676203" Oct 14 13:38:32.735343 master-0 kubenswrapper[4807]: I1014 13:38:32.735264 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-2" Oct 14 13:38:32.735343 master-0 kubenswrapper[4807]: I1014 13:38:32.735322 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-2" Oct 14 13:38:32.772176 master-0 kubenswrapper[4807]: I1014 13:38:32.767887 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-2" Oct 14 13:38:33.049233 master-0 kubenswrapper[4807]: I1014 13:38:33.049127 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerStarted","Data":"b88e5a31652b39677e490f548f779bec98ea6745633f28016b027552e3d6bd0b"} Oct 14 13:38:33.053702 master-0 kubenswrapper[4807]: I1014 13:38:33.053639 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerStarted","Data":"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec"} Oct 14 13:38:33.054011 master-0 kubenswrapper[4807]: I1014 13:38:33.053962 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-2" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-log" containerID="cri-o://4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" gracePeriod=30 Oct 14 13:38:33.054280 master-0 kubenswrapper[4807]: I1014 13:38:33.054235 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-2" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-metadata" containerID="cri-o://e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" gracePeriod=30 Oct 14 13:38:33.093493 master-0 kubenswrapper[4807]: I1014 13:38:33.093413 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-2" Oct 14 13:38:33.113708 master-0 kubenswrapper[4807]: I1014 13:38:33.113442 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:38:33.113708 master-0 kubenswrapper[4807]: I1014 13:38:33.113553 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:38:33.665416 master-0 kubenswrapper[4807]: I1014 13:38:33.665359 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:33.772792 master-0 kubenswrapper[4807]: I1014 13:38:33.772709 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle\") pod \"34c3d910-7aca-4f4e-9129-28794dee1163\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " Oct 14 13:38:33.773066 master-0 kubenswrapper[4807]: I1014 13:38:33.772860 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tstbg\" (UniqueName: \"kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg\") pod \"34c3d910-7aca-4f4e-9129-28794dee1163\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " Oct 14 13:38:33.773066 master-0 kubenswrapper[4807]: I1014 13:38:33.772912 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data\") pod \"34c3d910-7aca-4f4e-9129-28794dee1163\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " Oct 14 13:38:33.773066 master-0 kubenswrapper[4807]: I1014 13:38:33.772986 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs\") pod \"34c3d910-7aca-4f4e-9129-28794dee1163\" (UID: \"34c3d910-7aca-4f4e-9129-28794dee1163\") " Oct 14 13:38:33.773854 master-0 kubenswrapper[4807]: I1014 13:38:33.773770 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs" (OuterVolumeSpecName: "logs") pod "34c3d910-7aca-4f4e-9129-28794dee1163" (UID: "34c3d910-7aca-4f4e-9129-28794dee1163"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:38:33.777039 master-0 kubenswrapper[4807]: I1014 13:38:33.776953 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg" (OuterVolumeSpecName: "kube-api-access-tstbg") pod "34c3d910-7aca-4f4e-9129-28794dee1163" (UID: "34c3d910-7aca-4f4e-9129-28794dee1163"). InnerVolumeSpecName "kube-api-access-tstbg". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:33.798840 master-0 kubenswrapper[4807]: I1014 13:38:33.798748 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "34c3d910-7aca-4f4e-9129-28794dee1163" (UID: "34c3d910-7aca-4f4e-9129-28794dee1163"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:33.802525 master-0 kubenswrapper[4807]: I1014 13:38:33.802442 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data" (OuterVolumeSpecName: "config-data") pod "34c3d910-7aca-4f4e-9129-28794dee1163" (UID: "34c3d910-7aca-4f4e-9129-28794dee1163"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:33.876202 master-0 kubenswrapper[4807]: I1014 13:38:33.876122 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:33.876202 master-0 kubenswrapper[4807]: I1014 13:38:33.876182 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-tstbg\" (UniqueName: \"kubernetes.io/projected/34c3d910-7aca-4f4e-9129-28794dee1163-kube-api-access-tstbg\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:33.876202 master-0 kubenswrapper[4807]: I1014 13:38:33.876200 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/34c3d910-7aca-4f4e-9129-28794dee1163-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:33.876202 master-0 kubenswrapper[4807]: I1014 13:38:33.876213 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/34c3d910-7aca-4f4e-9129-28794dee1163-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:34.069147 master-0 kubenswrapper[4807]: I1014 13:38:34.069071 4807 generic.go:334] "Generic (PLEG): container finished" podID="34c3d910-7aca-4f4e-9129-28794dee1163" containerID="e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" exitCode=0 Oct 14 13:38:34.069147 master-0 kubenswrapper[4807]: I1014 13:38:34.069115 4807 generic.go:334] "Generic (PLEG): container finished" podID="34c3d910-7aca-4f4e-9129-28794dee1163" containerID="4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" exitCode=143 Oct 14 13:38:34.070589 master-0 kubenswrapper[4807]: I1014 13:38:34.070544 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:34.073940 master-0 kubenswrapper[4807]: I1014 13:38:34.073870 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerDied","Data":"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec"} Oct 14 13:38:34.074037 master-0 kubenswrapper[4807]: I1014 13:38:34.073969 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerDied","Data":"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416"} Oct 14 13:38:34.074037 master-0 kubenswrapper[4807]: I1014 13:38:34.073989 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"34c3d910-7aca-4f4e-9129-28794dee1163","Type":"ContainerDied","Data":"7f837f3e4c5cdc6bdc9212460719e7063d3a30174aecb9a1703e79a4867764d0"} Oct 14 13:38:34.074133 master-0 kubenswrapper[4807]: I1014 13:38:34.074019 4807 scope.go:117] "RemoveContainer" containerID="e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" Oct 14 13:38:34.115452 master-0 kubenswrapper[4807]: I1014 13:38:34.115386 4807 scope.go:117] "RemoveContainer" containerID="4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" Oct 14 13:38:34.133368 master-0 kubenswrapper[4807]: I1014 13:38:34.133305 4807 scope.go:117] "RemoveContainer" containerID="e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" Oct 14 13:38:34.134025 master-0 kubenswrapper[4807]: E1014 13:38:34.133975 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec\": container with ID starting with e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec not found: ID does not exist" containerID="e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" Oct 14 13:38:34.134088 master-0 kubenswrapper[4807]: I1014 13:38:34.134033 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec"} err="failed to get container status \"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec\": rpc error: code = NotFound desc = could not find container \"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec\": container with ID starting with e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec not found: ID does not exist" Oct 14 13:38:34.134088 master-0 kubenswrapper[4807]: I1014 13:38:34.134068 4807 scope.go:117] "RemoveContainer" containerID="4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" Oct 14 13:38:34.134674 master-0 kubenswrapper[4807]: E1014 13:38:34.134624 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416\": container with ID starting with 4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416 not found: ID does not exist" containerID="4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" Oct 14 13:38:34.134796 master-0 kubenswrapper[4807]: I1014 13:38:34.134767 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416"} err="failed to get container status \"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416\": rpc error: code = NotFound desc = could not find container \"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416\": container with ID starting with 4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416 not found: ID does not exist" Oct 14 13:38:34.134869 master-0 kubenswrapper[4807]: I1014 13:38:34.134857 4807 scope.go:117] "RemoveContainer" containerID="e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec" Oct 14 13:38:34.135479 master-0 kubenswrapper[4807]: I1014 13:38:34.135384 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec"} err="failed to get container status \"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec\": rpc error: code = NotFound desc = could not find container \"e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec\": container with ID starting with e78293619e5bdc41fecdfe6d2c10c5b384028a8005e26548f1e17a7e3ca3adec not found: ID does not exist" Oct 14 13:38:34.135479 master-0 kubenswrapper[4807]: I1014 13:38:34.135453 4807 scope.go:117] "RemoveContainer" containerID="4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416" Oct 14 13:38:34.135922 master-0 kubenswrapper[4807]: I1014 13:38:34.135899 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416"} err="failed to get container status \"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416\": rpc error: code = NotFound desc = could not find container \"4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416\": container with ID starting with 4d4ec4443633d00202d9ef34734a1edcb6ad1143003f2353bec37029c9d0a416 not found: ID does not exist" Oct 14 13:38:35.409574 master-0 kubenswrapper[4807]: I1014 13:38:35.409430 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-1" podStartSLOduration=4.960436376 podStartE2EDuration="13.409405776s" podCreationTimestamp="2025-10-14 13:38:22 +0000 UTC" firstStartedPulling="2025-10-14 13:38:23.185064123 +0000 UTC m=+1097.866365947" lastFinishedPulling="2025-10-14 13:38:31.634033523 +0000 UTC m=+1106.315335347" observedRunningTime="2025-10-14 13:38:35.40605894 +0000 UTC m=+1110.087360764" watchObservedRunningTime="2025-10-14 13:38:35.409405776 +0000 UTC m=+1110.090707600" Oct 14 13:38:35.520641 master-0 kubenswrapper[4807]: I1014 13:38:35.520562 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:35.568554 master-0 kubenswrapper[4807]: I1014 13:38:35.568484 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:35.603841 master-0 kubenswrapper[4807]: I1014 13:38:35.603750 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:38:35.604330 master-0 kubenswrapper[4807]: I1014 13:38:35.604244 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="dnsmasq-dns" containerID="cri-o://c497f27b692670dc81e454fb6ba9f048d3bdc5b40e321004c6547c108de6f88d" gracePeriod=10 Oct 14 13:38:35.657346 master-0 kubenswrapper[4807]: I1014 13:38:35.657136 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:35.657550 master-0 kubenswrapper[4807]: E1014 13:38:35.657523 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-metadata" Oct 14 13:38:35.657550 master-0 kubenswrapper[4807]: I1014 13:38:35.657541 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-metadata" Oct 14 13:38:35.657653 master-0 kubenswrapper[4807]: E1014 13:38:35.657562 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-log" Oct 14 13:38:35.657653 master-0 kubenswrapper[4807]: I1014 13:38:35.657570 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-log" Oct 14 13:38:35.657758 master-0 kubenswrapper[4807]: I1014 13:38:35.657699 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-log" Oct 14 13:38:35.657758 master-0 kubenswrapper[4807]: I1014 13:38:35.657717 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" containerName="nova-metadata-metadata" Oct 14 13:38:35.658649 master-0 kubenswrapper[4807]: I1014 13:38:35.658612 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:35.660776 master-0 kubenswrapper[4807]: I1014 13:38:35.660661 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Oct 14 13:38:35.661452 master-0 kubenswrapper[4807]: I1014 13:38:35.661424 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Oct 14 13:38:35.691861 master-0 kubenswrapper[4807]: I1014 13:38:35.689753 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:35.734367 master-0 kubenswrapper[4807]: I1014 13:38:35.734309 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk6ck\" (UniqueName: \"kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.734367 master-0 kubenswrapper[4807]: I1014 13:38:35.734369 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.734669 master-0 kubenswrapper[4807]: I1014 13:38:35.734399 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.734669 master-0 kubenswrapper[4807]: I1014 13:38:35.734563 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.734669 master-0 kubenswrapper[4807]: I1014 13:38:35.734590 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.777941 master-0 kubenswrapper[4807]: I1014 13:38:35.777844 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:35.800653 master-0 kubenswrapper[4807]: I1014 13:38:35.800558 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:35.814255 master-0 kubenswrapper[4807]: E1014 13:38:35.814140 4807 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[combined-ca-bundle config-data kube-api-access-mk6ck logs nova-metadata-tls-certs], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openstack/nova-metadata-2" podUID="5eff36c8-e26a-484a-9e62-f3c0d2a00c29" Oct 14 13:38:35.837195 master-0 kubenswrapper[4807]: I1014 13:38:35.837119 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-mk6ck\" (UniqueName: \"kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.837195 master-0 kubenswrapper[4807]: I1014 13:38:35.837185 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.837195 master-0 kubenswrapper[4807]: I1014 13:38:35.837214 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.837589 master-0 kubenswrapper[4807]: I1014 13:38:35.837238 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.837589 master-0 kubenswrapper[4807]: I1014 13:38:35.837256 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.838091 master-0 kubenswrapper[4807]: I1014 13:38:35.838029 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.841007 master-0 kubenswrapper[4807]: I1014 13:38:35.840842 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.841548 master-0 kubenswrapper[4807]: I1014 13:38:35.841501 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.851389 master-0 kubenswrapper[4807]: I1014 13:38:35.851339 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:35.891837 master-0 kubenswrapper[4807]: I1014 13:38:35.891765 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk6ck\" (UniqueName: \"kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck\") pod \"nova-metadata-2\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " pod="openstack/nova-metadata-2" Oct 14 13:38:36.098990 master-0 kubenswrapper[4807]: I1014 13:38:36.098918 4807 generic.go:334] "Generic (PLEG): container finished" podID="7f7543ce-015a-4f01-985f-b76efd804110" containerID="c497f27b692670dc81e454fb6ba9f048d3bdc5b40e321004c6547c108de6f88d" exitCode=0 Oct 14 13:38:36.099311 master-0 kubenswrapper[4807]: I1014 13:38:36.099062 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:36.099311 master-0 kubenswrapper[4807]: I1014 13:38:36.099255 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" event={"ID":"7f7543ce-015a-4f01-985f-b76efd804110","Type":"ContainerDied","Data":"c497f27b692670dc81e454fb6ba9f048d3bdc5b40e321004c6547c108de6f88d"} Oct 14 13:38:36.099860 master-0 kubenswrapper[4807]: I1014 13:38:36.099500 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-2" podUID="c2929482-e230-4e66-a326-f0de1561be36" containerName="nova-scheduler-scheduler" containerID="cri-o://66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" gracePeriod=30 Oct 14 13:38:36.149528 master-0 kubenswrapper[4807]: I1014 13:38:36.149472 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:36.157846 master-0 kubenswrapper[4807]: I1014 13:38:36.157815 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:38:36.246779 master-0 kubenswrapper[4807]: I1014 13:38:36.246694 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.247170 master-0 kubenswrapper[4807]: I1014 13:38:36.246844 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs\") pod \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " Oct 14 13:38:36.247170 master-0 kubenswrapper[4807]: I1014 13:38:36.246953 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hgtn\" (UniqueName: \"kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247251 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data\") pod \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247276 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle\") pod \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247308 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mk6ck\" (UniqueName: \"kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck\") pod \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247333 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs\") pod \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\" (UID: \"5eff36c8-e26a-484a-9e62-f3c0d2a00c29\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247387 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247416 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.247517 master-0 kubenswrapper[4807]: I1014 13:38:36.247437 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.247778 master-0 kubenswrapper[4807]: I1014 13:38:36.247559 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb\") pod \"7f7543ce-015a-4f01-985f-b76efd804110\" (UID: \"7f7543ce-015a-4f01-985f-b76efd804110\") " Oct 14 13:38:36.252978 master-0 kubenswrapper[4807]: I1014 13:38:36.252934 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck" (OuterVolumeSpecName: "kube-api-access-mk6ck") pod "5eff36c8-e26a-484a-9e62-f3c0d2a00c29" (UID: "5eff36c8-e26a-484a-9e62-f3c0d2a00c29"). InnerVolumeSpecName "kube-api-access-mk6ck". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:36.257005 master-0 kubenswrapper[4807]: I1014 13:38:36.256936 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "5eff36c8-e26a-484a-9e62-f3c0d2a00c29" (UID: "5eff36c8-e26a-484a-9e62-f3c0d2a00c29"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:36.260974 master-0 kubenswrapper[4807]: I1014 13:38:36.260956 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn" (OuterVolumeSpecName: "kube-api-access-7hgtn") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "kube-api-access-7hgtn". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:36.262218 master-0 kubenswrapper[4807]: I1014 13:38:36.262156 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data" (OuterVolumeSpecName: "config-data") pod "5eff36c8-e26a-484a-9e62-f3c0d2a00c29" (UID: "5eff36c8-e26a-484a-9e62-f3c0d2a00c29"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:36.262558 master-0 kubenswrapper[4807]: I1014 13:38:36.262523 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs" (OuterVolumeSpecName: "logs") pod "5eff36c8-e26a-484a-9e62-f3c0d2a00c29" (UID: "5eff36c8-e26a-484a-9e62-f3c0d2a00c29"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:38:36.264736 master-0 kubenswrapper[4807]: I1014 13:38:36.264702 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "5eff36c8-e26a-484a-9e62-f3c0d2a00c29" (UID: "5eff36c8-e26a-484a-9e62-f3c0d2a00c29"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:36.295867 master-0 kubenswrapper[4807]: I1014 13:38:36.295779 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34c3d910-7aca-4f4e-9129-28794dee1163" path="/var/lib/kubelet/pods/34c3d910-7aca-4f4e-9129-28794dee1163/volumes" Oct 14 13:38:36.306103 master-0 kubenswrapper[4807]: I1014 13:38:36.305972 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config" (OuterVolumeSpecName: "config") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "config". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:38:36.307914 master-0 kubenswrapper[4807]: I1014 13:38:36.307844 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb" (OuterVolumeSpecName: "ovsdbserver-nb") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "ovsdbserver-nb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:38:36.314676 master-0 kubenswrapper[4807]: I1014 13:38:36.314609 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc" (OuterVolumeSpecName: "dns-svc") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "dns-svc". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:38:36.322944 master-0 kubenswrapper[4807]: I1014 13:38:36.322852 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb" (OuterVolumeSpecName: "ovsdbserver-sb") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "ovsdbserver-sb". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:38:36.332384 master-0 kubenswrapper[4807]: I1014 13:38:36.332246 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0" (OuterVolumeSpecName: "dns-swift-storage-0") pod "7f7543ce-015a-4f01-985f-b76efd804110" (UID: "7f7543ce-015a-4f01-985f-b76efd804110"). InnerVolumeSpecName "dns-swift-storage-0". PluginName "kubernetes.io/configmap", VolumeGidValue "" Oct 14 13:38:36.356265 master-0 kubenswrapper[4807]: I1014 13:38:36.356201 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356265 master-0 kubenswrapper[4807]: I1014 13:38:36.356244 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356265 master-0 kubenswrapper[4807]: I1014 13:38:36.356258 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-mk6ck\" (UniqueName: \"kubernetes.io/projected/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-kube-api-access-mk6ck\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356265 master-0 kubenswrapper[4807]: I1014 13:38:36.356274 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356325 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-sb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356339 4807 reconciler_common.go:293] "Volume detached for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-swift-storage-0\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356349 4807 reconciler_common.go:293] "Volume detached for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-dns-svc\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356362 4807 reconciler_common.go:293] "Volume detached for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-ovsdbserver-nb\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356375 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7f7543ce-015a-4f01-985f-b76efd804110-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356385 4807 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/5eff36c8-e26a-484a-9e62-f3c0d2a00c29-nova-metadata-tls-certs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:36.356731 master-0 kubenswrapper[4807]: I1014 13:38:36.356395 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-7hgtn\" (UniqueName: \"kubernetes.io/projected/7f7543ce-015a-4f01-985f-b76efd804110-kube-api-access-7hgtn\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:37.113583 master-0 kubenswrapper[4807]: I1014 13:38:37.113493 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:37.113583 master-0 kubenswrapper[4807]: I1014 13:38:37.113513 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" event={"ID":"7f7543ce-015a-4f01-985f-b76efd804110","Type":"ContainerDied","Data":"5eb144563c6e3ee8b29ebc42ec9fb0500a353088c3d788d635c606494ecba67e"} Oct 14 13:38:37.113583 master-0 kubenswrapper[4807]: I1014 13:38:37.113591 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-6f8b568997-sphlq" Oct 14 13:38:37.115617 master-0 kubenswrapper[4807]: I1014 13:38:37.113705 4807 scope.go:117] "RemoveContainer" containerID="c497f27b692670dc81e454fb6ba9f048d3bdc5b40e321004c6547c108de6f88d" Oct 14 13:38:37.147888 master-0 kubenswrapper[4807]: I1014 13:38:37.147818 4807 scope.go:117] "RemoveContainer" containerID="de25711026901643293d9a08525d7de594181e968633388d08f9380cf9cd8e11" Oct 14 13:38:37.196482 master-0 kubenswrapper[4807]: I1014 13:38:37.196394 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:37.213582 master-0 kubenswrapper[4807]: I1014 13:38:37.213493 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:37.240743 master-0 kubenswrapper[4807]: I1014 13:38:37.240664 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:38:37.276324 master-0 kubenswrapper[4807]: I1014 13:38:37.276168 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:37.276649 master-0 kubenswrapper[4807]: E1014 13:38:37.276612 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="dnsmasq-dns" Oct 14 13:38:37.276649 master-0 kubenswrapper[4807]: I1014 13:38:37.276627 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="dnsmasq-dns" Oct 14 13:38:37.276649 master-0 kubenswrapper[4807]: E1014 13:38:37.276641 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="init" Oct 14 13:38:37.276649 master-0 kubenswrapper[4807]: I1014 13:38:37.276648 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="init" Oct 14 13:38:37.276824 master-0 kubenswrapper[4807]: I1014 13:38:37.276795 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="7f7543ce-015a-4f01-985f-b76efd804110" containerName="dnsmasq-dns" Oct 14 13:38:37.277776 master-0 kubenswrapper[4807]: I1014 13:38:37.277729 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:37.283509 master-0 kubenswrapper[4807]: I1014 13:38:37.283338 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Oct 14 13:38:37.295712 master-0 kubenswrapper[4807]: I1014 13:38:37.294926 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/dnsmasq-dns-6f8b568997-sphlq"] Oct 14 13:38:37.297190 master-0 kubenswrapper[4807]: I1014 13:38:37.297145 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Oct 14 13:38:37.315724 master-0 kubenswrapper[4807]: I1014 13:38:37.315626 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:37.388798 master-0 kubenswrapper[4807]: I1014 13:38:37.388203 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.388798 master-0 kubenswrapper[4807]: I1014 13:38:37.388324 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.388798 master-0 kubenswrapper[4807]: I1014 13:38:37.388365 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.388798 master-0 kubenswrapper[4807]: I1014 13:38:37.388387 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2g27\" (UniqueName: \"kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.388798 master-0 kubenswrapper[4807]: I1014 13:38:37.388426 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.491068 master-0 kubenswrapper[4807]: I1014 13:38:37.490649 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.491068 master-0 kubenswrapper[4807]: I1014 13:38:37.490725 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.491068 master-0 kubenswrapper[4807]: I1014 13:38:37.490751 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-n2g27\" (UniqueName: \"kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.491068 master-0 kubenswrapper[4807]: I1014 13:38:37.490808 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.491068 master-0 kubenswrapper[4807]: I1014 13:38:37.490853 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.493113 master-0 kubenswrapper[4807]: I1014 13:38:37.493086 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.494344 master-0 kubenswrapper[4807]: I1014 13:38:37.494314 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.495901 master-0 kubenswrapper[4807]: I1014 13:38:37.495856 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.496064 master-0 kubenswrapper[4807]: I1014 13:38:37.496005 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.510328 master-0 kubenswrapper[4807]: I1014 13:38:37.510292 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2g27\" (UniqueName: \"kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27\") pod \"nova-metadata-2\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " pod="openstack/nova-metadata-2" Oct 14 13:38:37.606544 master-0 kubenswrapper[4807]: I1014 13:38:37.604485 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:38:37.741344 master-0 kubenswrapper[4807]: E1014 13:38:37.741286 4807 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f is running failed: container process not found" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Oct 14 13:38:37.741942 master-0 kubenswrapper[4807]: E1014 13:38:37.741896 4807 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f is running failed: container process not found" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Oct 14 13:38:37.742266 master-0 kubenswrapper[4807]: E1014 13:38:37.742233 4807 log.go:32] "ExecSync cmd from runtime service failed" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f is running failed: container process not found" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" cmd=["/usr/bin/pgrep","-r","DRST","nova-scheduler"] Oct 14 13:38:37.742364 master-0 kubenswrapper[4807]: E1014 13:38:37.742277 4807 prober.go:104] "Probe errored" err="rpc error: code = NotFound desc = container is not created or running: checking if PID of 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f is running failed: container process not found" probeType="Readiness" pod="openstack/nova-scheduler-2" podUID="c2929482-e230-4e66-a326-f0de1561be36" containerName="nova-scheduler-scheduler" Oct 14 13:38:37.890221 master-0 kubenswrapper[4807]: I1014 13:38:37.889677 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:38.001827 master-0 kubenswrapper[4807]: I1014 13:38:38.001668 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6tfz\" (UniqueName: \"kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz\") pod \"c2929482-e230-4e66-a326-f0de1561be36\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " Oct 14 13:38:38.002058 master-0 kubenswrapper[4807]: I1014 13:38:38.001923 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data\") pod \"c2929482-e230-4e66-a326-f0de1561be36\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " Oct 14 13:38:38.002106 master-0 kubenswrapper[4807]: I1014 13:38:38.002054 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle\") pod \"c2929482-e230-4e66-a326-f0de1561be36\" (UID: \"c2929482-e230-4e66-a326-f0de1561be36\") " Oct 14 13:38:38.006151 master-0 kubenswrapper[4807]: I1014 13:38:38.006077 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz" (OuterVolumeSpecName: "kube-api-access-v6tfz") pod "c2929482-e230-4e66-a326-f0de1561be36" (UID: "c2929482-e230-4e66-a326-f0de1561be36"). InnerVolumeSpecName "kube-api-access-v6tfz". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:38.038657 master-0 kubenswrapper[4807]: I1014 13:38:38.038565 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "c2929482-e230-4e66-a326-f0de1561be36" (UID: "c2929482-e230-4e66-a326-f0de1561be36"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:38.058793 master-0 kubenswrapper[4807]: I1014 13:38:38.058699 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data" (OuterVolumeSpecName: "config-data") pod "c2929482-e230-4e66-a326-f0de1561be36" (UID: "c2929482-e230-4e66-a326-f0de1561be36"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:38.105616 master-0 kubenswrapper[4807]: I1014 13:38:38.105559 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:38.105844 master-0 kubenswrapper[4807]: I1014 13:38:38.105823 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c2929482-e230-4e66-a326-f0de1561be36-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:38.105940 master-0 kubenswrapper[4807]: I1014 13:38:38.105924 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-v6tfz\" (UniqueName: \"kubernetes.io/projected/c2929482-e230-4e66-a326-f0de1561be36-kube-api-access-v6tfz\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:38.137536 master-0 kubenswrapper[4807]: I1014 13:38:38.132594 4807 generic.go:334] "Generic (PLEG): container finished" podID="c2929482-e230-4e66-a326-f0de1561be36" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" exitCode=0 Oct 14 13:38:38.137536 master-0 kubenswrapper[4807]: I1014 13:38:38.132674 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"c2929482-e230-4e66-a326-f0de1561be36","Type":"ContainerDied","Data":"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f"} Oct 14 13:38:38.137536 master-0 kubenswrapper[4807]: I1014 13:38:38.132715 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"c2929482-e230-4e66-a326-f0de1561be36","Type":"ContainerDied","Data":"f434442579ac2c07399a166567f5790ad955616c215e32fa1b0f83d3cbd72d46"} Oct 14 13:38:38.137536 master-0 kubenswrapper[4807]: I1014 13:38:38.132762 4807 scope.go:117] "RemoveContainer" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" Oct 14 13:38:38.137536 master-0 kubenswrapper[4807]: I1014 13:38:38.132795 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:38.160918 master-0 kubenswrapper[4807]: I1014 13:38:38.160889 4807 scope.go:117] "RemoveContainer" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" Oct 14 13:38:38.162126 master-0 kubenswrapper[4807]: E1014 13:38:38.162076 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f\": container with ID starting with 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f not found: ID does not exist" containerID="66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f" Oct 14 13:38:38.162243 master-0 kubenswrapper[4807]: I1014 13:38:38.162212 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f"} err="failed to get container status \"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f\": rpc error: code = NotFound desc = could not find container \"66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f\": container with ID starting with 66c06c4efb3d5d10d14c7a8c04f2fdaf4827654b755fff7c6cb9e4f9d6fba06f not found: ID does not exist" Oct 14 13:38:38.169406 master-0 kubenswrapper[4807]: I1014 13:38:38.168779 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:38:38.194000 master-0 kubenswrapper[4807]: I1014 13:38:38.193960 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:38.199142 master-0 kubenswrapper[4807]: I1014 13:38:38.199086 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:38.237922 master-0 kubenswrapper[4807]: I1014 13:38:38.237864 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:38.238515 master-0 kubenswrapper[4807]: E1014 13:38:38.238203 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="c2929482-e230-4e66-a326-f0de1561be36" containerName="nova-scheduler-scheduler" Oct 14 13:38:38.238515 master-0 kubenswrapper[4807]: I1014 13:38:38.238218 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2929482-e230-4e66-a326-f0de1561be36" containerName="nova-scheduler-scheduler" Oct 14 13:38:38.238515 master-0 kubenswrapper[4807]: I1014 13:38:38.238372 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="c2929482-e230-4e66-a326-f0de1561be36" containerName="nova-scheduler-scheduler" Oct 14 13:38:38.239056 master-0 kubenswrapper[4807]: I1014 13:38:38.239031 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:38.243117 master-0 kubenswrapper[4807]: I1014 13:38:38.242762 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Oct 14 13:38:38.250359 master-0 kubenswrapper[4807]: I1014 13:38:38.250308 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:38.287224 master-0 kubenswrapper[4807]: I1014 13:38:38.287178 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5eff36c8-e26a-484a-9e62-f3c0d2a00c29" path="/var/lib/kubelet/pods/5eff36c8-e26a-484a-9e62-f3c0d2a00c29/volumes" Oct 14 13:38:38.288089 master-0 kubenswrapper[4807]: I1014 13:38:38.288067 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f7543ce-015a-4f01-985f-b76efd804110" path="/var/lib/kubelet/pods/7f7543ce-015a-4f01-985f-b76efd804110/volumes" Oct 14 13:38:38.289722 master-0 kubenswrapper[4807]: I1014 13:38:38.289699 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2929482-e230-4e66-a326-f0de1561be36" path="/var/lib/kubelet/pods/c2929482-e230-4e66-a326-f0de1561be36/volumes" Oct 14 13:38:38.311337 master-0 kubenswrapper[4807]: I1014 13:38:38.311255 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.311604 master-0 kubenswrapper[4807]: I1014 13:38:38.311428 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfbvw\" (UniqueName: \"kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.311604 master-0 kubenswrapper[4807]: I1014 13:38:38.311534 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.414131 master-0 kubenswrapper[4807]: I1014 13:38:38.414062 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.414131 master-0 kubenswrapper[4807]: I1014 13:38:38.414153 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-lfbvw\" (UniqueName: \"kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.414568 master-0 kubenswrapper[4807]: I1014 13:38:38.414201 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.424558 master-0 kubenswrapper[4807]: I1014 13:38:38.423001 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.437772 master-0 kubenswrapper[4807]: I1014 13:38:38.436668 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.451227 master-0 kubenswrapper[4807]: I1014 13:38:38.449527 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfbvw\" (UniqueName: \"kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw\") pod \"nova-scheduler-2\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " pod="openstack/nova-scheduler-2" Oct 14 13:38:38.596145 master-0 kubenswrapper[4807]: I1014 13:38:38.596040 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:38:39.084408 master-0 kubenswrapper[4807]: I1014 13:38:39.084321 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:38:39.099139 master-0 kubenswrapper[4807]: W1014 13:38:39.092484 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4d2f942d_2f17_4f57_a7bd_cd61f865b850.slice/crio-66d4edb3698be6324f23e7fe77b10165780716ca0cad803491e75e5207d6002d WatchSource:0}: Error finding container 66d4edb3698be6324f23e7fe77b10165780716ca0cad803491e75e5207d6002d: Status 404 returned error can't find the container with id 66d4edb3698be6324f23e7fe77b10165780716ca0cad803491e75e5207d6002d Oct 14 13:38:39.166314 master-0 kubenswrapper[4807]: I1014 13:38:39.166241 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerStarted","Data":"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e"} Oct 14 13:38:39.166314 master-0 kubenswrapper[4807]: I1014 13:38:39.166320 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerStarted","Data":"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9"} Oct 14 13:38:39.166314 master-0 kubenswrapper[4807]: I1014 13:38:39.166334 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerStarted","Data":"f348312902a9b3f7b06945cf7a32b4ee1ad05c67a1cfa48d7c8069fd490fd3d2"} Oct 14 13:38:39.170065 master-0 kubenswrapper[4807]: I1014 13:38:39.170011 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"4d2f942d-2f17-4f57-a7bd-cd61f865b850","Type":"ContainerStarted","Data":"66d4edb3698be6324f23e7fe77b10165780716ca0cad803491e75e5207d6002d"} Oct 14 13:38:39.269495 master-0 kubenswrapper[4807]: I1014 13:38:39.231593 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-2" podStartSLOduration=2.2315669 podStartE2EDuration="2.2315669s" podCreationTimestamp="2025-10-14 13:38:37 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:38:39.20078942 +0000 UTC m=+1113.882091274" watchObservedRunningTime="2025-10-14 13:38:39.2315669 +0000 UTC m=+1113.912868734" Oct 14 13:38:40.207111 master-0 kubenswrapper[4807]: I1014 13:38:40.207022 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"4d2f942d-2f17-4f57-a7bd-cd61f865b850","Type":"ContainerStarted","Data":"7c544a3e0f1568592da8ae6e2019c20023e21d38fb40e766eaa5ee2cd1ec3ecc"} Oct 14 13:38:40.251685 master-0 kubenswrapper[4807]: I1014 13:38:40.251562 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-2" podStartSLOduration=2.251534176 podStartE2EDuration="2.251534176s" podCreationTimestamp="2025-10-14 13:38:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:38:40.249183586 +0000 UTC m=+1114.930485410" watchObservedRunningTime="2025-10-14 13:38:40.251534176 +0000 UTC m=+1114.932836000" Oct 14 13:38:42.605370 master-0 kubenswrapper[4807]: I1014 13:38:42.605304 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:38:42.605889 master-0 kubenswrapper[4807]: I1014 13:38:42.605751 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:38:42.619218 master-0 kubenswrapper[4807]: I1014 13:38:42.619134 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:38:42.619291 master-0 kubenswrapper[4807]: I1014 13:38:42.619251 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:38:43.597201 master-0 kubenswrapper[4807]: I1014 13:38:43.597052 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-2" Oct 14 13:38:43.701882 master-0 kubenswrapper[4807]: I1014 13:38:43.701787 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.130.0.119:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:38:43.702569 master-0 kubenswrapper[4807]: I1014 13:38:43.701800 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.130.0.119:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:38:45.238031 master-0 kubenswrapper[4807]: I1014 13:38:45.237957 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack_neutron-55c4fcb4cb-sszff_8a34fbea-a683-44e5-897f-6c45e88b0c02/neutron-api/0.log" Oct 14 13:38:45.238031 master-0 kubenswrapper[4807]: I1014 13:38:45.238032 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:38:45.253992 master-0 kubenswrapper[4807]: I1014 13:38:45.253928 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openstack_neutron-55c4fcb4cb-sszff_8a34fbea-a683-44e5-897f-6c45e88b0c02/neutron-api/0.log" Oct 14 13:38:45.253992 master-0 kubenswrapper[4807]: I1014 13:38:45.253993 4807 generic.go:334] "Generic (PLEG): container finished" podID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerID="ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd" exitCode=137 Oct 14 13:38:45.254239 master-0 kubenswrapper[4807]: I1014 13:38:45.254025 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerDied","Data":"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd"} Oct 14 13:38:45.254239 master-0 kubenswrapper[4807]: I1014 13:38:45.254056 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/neutron-55c4fcb4cb-sszff" event={"ID":"8a34fbea-a683-44e5-897f-6c45e88b0c02","Type":"ContainerDied","Data":"37ad9f0b0949050f2b28ab3249121c88d0bc5485616772355da42c2ef85553e0"} Oct 14 13:38:45.254239 master-0 kubenswrapper[4807]: I1014 13:38:45.254075 4807 scope.go:117] "RemoveContainer" containerID="eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c" Oct 14 13:38:45.254239 master-0 kubenswrapper[4807]: I1014 13:38:45.254203 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/neutron-55c4fcb4cb-sszff" Oct 14 13:38:45.274593 master-0 kubenswrapper[4807]: I1014 13:38:45.274545 4807 scope.go:117] "RemoveContainer" containerID="ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd" Oct 14 13:38:45.298892 master-0 kubenswrapper[4807]: I1014 13:38:45.298843 4807 scope.go:117] "RemoveContainer" containerID="eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c" Oct 14 13:38:45.301888 master-0 kubenswrapper[4807]: E1014 13:38:45.301833 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c\": container with ID starting with eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c not found: ID does not exist" containerID="eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c" Oct 14 13:38:45.301967 master-0 kubenswrapper[4807]: I1014 13:38:45.301897 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c"} err="failed to get container status \"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c\": rpc error: code = NotFound desc = could not find container \"eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c\": container with ID starting with eabfdccd5e81afaa52195eef99a7b2810ce182251d39751bbe2f8f45cada7d1c not found: ID does not exist" Oct 14 13:38:45.301967 master-0 kubenswrapper[4807]: I1014 13:38:45.301936 4807 scope.go:117] "RemoveContainer" containerID="ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd" Oct 14 13:38:45.302671 master-0 kubenswrapper[4807]: E1014 13:38:45.302625 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd\": container with ID starting with ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd not found: ID does not exist" containerID="ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd" Oct 14 13:38:45.302671 master-0 kubenswrapper[4807]: I1014 13:38:45.302659 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd"} err="failed to get container status \"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd\": rpc error: code = NotFound desc = could not find container \"ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd\": container with ID starting with ad8e4c918796e8bdd060814caffbcb6dbd6867d710577e152ee2289b9f3d4ecd not found: ID does not exist" Oct 14 13:38:45.361539 master-0 kubenswrapper[4807]: I1014 13:38:45.361386 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle\") pod \"8a34fbea-a683-44e5-897f-6c45e88b0c02\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " Oct 14 13:38:45.361539 master-0 kubenswrapper[4807]: I1014 13:38:45.361557 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config\") pod \"8a34fbea-a683-44e5-897f-6c45e88b0c02\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " Oct 14 13:38:45.362288 master-0 kubenswrapper[4807]: I1014 13:38:45.362256 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs\") pod \"8a34fbea-a683-44e5-897f-6c45e88b0c02\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " Oct 14 13:38:45.362429 master-0 kubenswrapper[4807]: I1014 13:38:45.362378 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtq8j\" (UniqueName: \"kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j\") pod \"8a34fbea-a683-44e5-897f-6c45e88b0c02\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " Oct 14 13:38:45.362533 master-0 kubenswrapper[4807]: I1014 13:38:45.362506 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config\") pod \"8a34fbea-a683-44e5-897f-6c45e88b0c02\" (UID: \"8a34fbea-a683-44e5-897f-6c45e88b0c02\") " Oct 14 13:38:45.366256 master-0 kubenswrapper[4807]: I1014 13:38:45.366182 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config" (OuterVolumeSpecName: "httpd-config") pod "8a34fbea-a683-44e5-897f-6c45e88b0c02" (UID: "8a34fbea-a683-44e5-897f-6c45e88b0c02"). InnerVolumeSpecName "httpd-config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:45.367026 master-0 kubenswrapper[4807]: I1014 13:38:45.366981 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j" (OuterVolumeSpecName: "kube-api-access-dtq8j") pod "8a34fbea-a683-44e5-897f-6c45e88b0c02" (UID: "8a34fbea-a683-44e5-897f-6c45e88b0c02"). InnerVolumeSpecName "kube-api-access-dtq8j". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:38:45.408682 master-0 kubenswrapper[4807]: I1014 13:38:45.408522 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "8a34fbea-a683-44e5-897f-6c45e88b0c02" (UID: "8a34fbea-a683-44e5-897f-6c45e88b0c02"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:45.425608 master-0 kubenswrapper[4807]: I1014 13:38:45.423314 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config" (OuterVolumeSpecName: "config") pod "8a34fbea-a683-44e5-897f-6c45e88b0c02" (UID: "8a34fbea-a683-44e5-897f-6c45e88b0c02"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:45.456537 master-0 kubenswrapper[4807]: I1014 13:38:45.456425 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs" (OuterVolumeSpecName: "ovndb-tls-certs") pod "8a34fbea-a683-44e5-897f-6c45e88b0c02" (UID: "8a34fbea-a683-44e5-897f-6c45e88b0c02"). InnerVolumeSpecName "ovndb-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:38:45.465136 master-0 kubenswrapper[4807]: I1014 13:38:45.465052 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:45.465136 master-0 kubenswrapper[4807]: I1014 13:38:45.465115 4807 reconciler_common.go:293] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:45.465136 master-0 kubenswrapper[4807]: I1014 13:38:45.465133 4807 reconciler_common.go:293] "Volume detached for volume \"ovndb-tls-certs\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-ovndb-tls-certs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:45.465136 master-0 kubenswrapper[4807]: I1014 13:38:45.465149 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-dtq8j\" (UniqueName: \"kubernetes.io/projected/8a34fbea-a683-44e5-897f-6c45e88b0c02-kube-api-access-dtq8j\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:45.465136 master-0 kubenswrapper[4807]: I1014 13:38:45.465162 4807 reconciler_common.go:293] "Volume detached for volume \"httpd-config\" (UniqueName: \"kubernetes.io/secret/8a34fbea-a683-44e5-897f-6c45e88b0c02-httpd-config\") on node \"master-0\" DevicePath \"\"" Oct 14 13:38:45.610270 master-0 kubenswrapper[4807]: I1014 13:38:45.610175 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:38:45.622342 master-0 kubenswrapper[4807]: I1014 13:38:45.622260 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-55c4fcb4cb-sszff"] Oct 14 13:38:46.273651 master-0 kubenswrapper[4807]: I1014 13:38:46.273479 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" path="/var/lib/kubelet/pods/8a34fbea-a683-44e5-897f-6c45e88b0c02/volumes" Oct 14 13:38:47.606177 master-0 kubenswrapper[4807]: I1014 13:38:47.606091 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-2" Oct 14 13:38:47.606177 master-0 kubenswrapper[4807]: I1014 13:38:47.606159 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-2" Oct 14 13:38:48.597239 master-0 kubenswrapper[4807]: I1014 13:38:48.597158 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-2" Oct 14 13:38:48.630698 master-0 kubenswrapper[4807]: I1014 13:38:48.619760 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.130.0.123:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:38:48.630698 master-0 kubenswrapper[4807]: I1014 13:38:48.630401 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.130.0.123:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:38:48.657058 master-0 kubenswrapper[4807]: I1014 13:38:48.656982 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-2" Oct 14 13:38:49.323776 master-0 kubenswrapper[4807]: I1014 13:38:49.323724 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-2" Oct 14 13:38:52.619501 master-0 kubenswrapper[4807]: I1014 13:38:52.619388 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:38:52.619501 master-0 kubenswrapper[4807]: I1014 13:38:52.619499 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:38:52.624399 master-0 kubenswrapper[4807]: I1014 13:38:52.624332 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:38:52.625320 master-0 kubenswrapper[4807]: I1014 13:38:52.625283 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:38:53.351955 master-0 kubenswrapper[4807]: I1014 13:38:53.351873 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:38:53.353927 master-0 kubenswrapper[4807]: I1014 13:38:53.353840 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:38:57.617979 master-0 kubenswrapper[4807]: I1014 13:38:57.617276 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-2" Oct 14 13:38:57.619128 master-0 kubenswrapper[4807]: I1014 13:38:57.618766 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-2" Oct 14 13:38:57.625881 master-0 kubenswrapper[4807]: I1014 13:38:57.625827 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-2" Oct 14 13:38:58.412933 master-0 kubenswrapper[4807]: I1014 13:38:58.412837 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-2" Oct 14 13:39:05.895192 master-0 kubenswrapper[4807]: I1014 13:39:05.895009 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:05.896028 master-0 kubenswrapper[4807]: I1014 13:39:05.895575 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-1" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-log" containerID="cri-o://fd3d2986d5003596a60e30f6b335a1985525936e39c1ba8950d48e91dc164b4a" gracePeriod=30 Oct 14 13:39:05.896028 master-0 kubenswrapper[4807]: I1014 13:39:05.895738 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-1" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-api" containerID="cri-o://b88e5a31652b39677e490f548f779bec98ea6745633f28016b027552e3d6bd0b" gracePeriod=30 Oct 14 13:39:06.154752 master-0 kubenswrapper[4807]: I1014 13:39:06.154589 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/dnsmasq-dns-559c6f967c-6vxg9"] Oct 14 13:39:06.155065 master-0 kubenswrapper[4807]: E1014 13:39:06.155030 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-api" Oct 14 13:39:06.155109 master-0 kubenswrapper[4807]: I1014 13:39:06.155066 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-api" Oct 14 13:39:06.155109 master-0 kubenswrapper[4807]: E1014 13:39:06.155096 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-httpd" Oct 14 13:39:06.155109 master-0 kubenswrapper[4807]: I1014 13:39:06.155105 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-httpd" Oct 14 13:39:06.155547 master-0 kubenswrapper[4807]: I1014 13:39:06.155511 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-api" Oct 14 13:39:06.155547 master-0 kubenswrapper[4807]: I1014 13:39:06.155546 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="8a34fbea-a683-44e5-897f-6c45e88b0c02" containerName="neutron-httpd" Oct 14 13:39:06.156864 master-0 kubenswrapper[4807]: I1014 13:39:06.156761 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.160091 master-0 kubenswrapper[4807]: I1014 13:39:06.160027 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-nb" Oct 14 13:39:06.160091 master-0 kubenswrapper[4807]: I1014 13:39:06.160027 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns" Oct 14 13:39:06.160319 master-0 kubenswrapper[4807]: I1014 13:39:06.160095 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-svc" Oct 14 13:39:06.160705 master-0 kubenswrapper[4807]: I1014 13:39:06.160672 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"ovsdbserver-sb" Oct 14 13:39:06.160829 master-0 kubenswrapper[4807]: I1014 13:39:06.160787 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"dns-swift-storage-0" Oct 14 13:39:06.165413 master-0 kubenswrapper[4807]: I1014 13:39:06.165353 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-559c6f967c-6vxg9"] Oct 14 13:39:06.210432 master-0 kubenswrapper[4807]: I1014 13:39:06.210303 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-nb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.210432 master-0 kubenswrapper[4807]: I1014 13:39:06.210365 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-swift-storage-0\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.210432 master-0 kubenswrapper[4807]: I1014 13:39:06.210398 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-svc\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.210809 master-0 kubenswrapper[4807]: I1014 13:39:06.210480 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-sb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.210809 master-0 kubenswrapper[4807]: I1014 13:39:06.210649 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-config\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.210809 master-0 kubenswrapper[4807]: I1014 13:39:06.210703 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dpqs\" (UniqueName: \"kubernetes.io/projected/b5c316a0-59ee-4d79-89f3-198895529796-kube-api-access-8dpqs\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312639 master-0 kubenswrapper[4807]: I1014 13:39:06.312535 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-nb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312930 master-0 kubenswrapper[4807]: I1014 13:39:06.312698 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-swift-storage-0\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312930 master-0 kubenswrapper[4807]: I1014 13:39:06.312728 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-svc\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312930 master-0 kubenswrapper[4807]: I1014 13:39:06.312820 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-sb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312930 master-0 kubenswrapper[4807]: I1014 13:39:06.312872 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-config\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.312930 master-0 kubenswrapper[4807]: I1014 13:39:06.312906 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-8dpqs\" (UniqueName: \"kubernetes.io/projected/b5c316a0-59ee-4d79-89f3-198895529796-kube-api-access-8dpqs\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.314582 master-0 kubenswrapper[4807]: I1014 13:39:06.314342 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-nb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-nb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.314582 master-0 kubenswrapper[4807]: I1014 13:39:06.314497 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-svc\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-svc\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.314582 master-0 kubenswrapper[4807]: I1014 13:39:06.314525 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"ovsdbserver-sb\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-ovsdbserver-sb\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.314998 master-0 kubenswrapper[4807]: I1014 13:39:06.314941 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"dns-swift-storage-0\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-dns-swift-storage-0\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.315616 master-0 kubenswrapper[4807]: I1014 13:39:06.315539 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b5c316a0-59ee-4d79-89f3-198895529796-config\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.341006 master-0 kubenswrapper[4807]: I1014 13:39:06.340923 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dpqs\" (UniqueName: \"kubernetes.io/projected/b5c316a0-59ee-4d79-89f3-198895529796-kube-api-access-8dpqs\") pod \"dnsmasq-dns-559c6f967c-6vxg9\" (UID: \"b5c316a0-59ee-4d79-89f3-198895529796\") " pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.488900 master-0 kubenswrapper[4807]: I1014 13:39:06.488719 4807 generic.go:334] "Generic (PLEG): container finished" podID="d84e5841-9c39-4199-9c89-74526741050d" containerID="fd3d2986d5003596a60e30f6b335a1985525936e39c1ba8950d48e91dc164b4a" exitCode=143 Oct 14 13:39:06.488900 master-0 kubenswrapper[4807]: I1014 13:39:06.488801 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerDied","Data":"fd3d2986d5003596a60e30f6b335a1985525936e39c1ba8950d48e91dc164b4a"} Oct 14 13:39:06.523550 master-0 kubenswrapper[4807]: I1014 13:39:06.523402 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:06.882927 master-0 kubenswrapper[4807]: I1014 13:39:06.882871 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/dnsmasq-dns-559c6f967c-6vxg9"] Oct 14 13:39:06.896432 master-0 kubenswrapper[4807]: W1014 13:39:06.896366 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb5c316a0_59ee_4d79_89f3_198895529796.slice/crio-10b062f03c1723d2d2d869ea0415f11b4457503d072909b69542eccef9156c3c WatchSource:0}: Error finding container 10b062f03c1723d2d2d869ea0415f11b4457503d072909b69542eccef9156c3c: Status 404 returned error can't find the container with id 10b062f03c1723d2d2d869ea0415f11b4457503d072909b69542eccef9156c3c Oct 14 13:39:07.502188 master-0 kubenswrapper[4807]: I1014 13:39:07.502125 4807 generic.go:334] "Generic (PLEG): container finished" podID="b5c316a0-59ee-4d79-89f3-198895529796" containerID="93fe7c68ce0078bbc56a0fdff22a5739f5a4bf6892d0ae2c657f8a0ee9c9c414" exitCode=0 Oct 14 13:39:07.502606 master-0 kubenswrapper[4807]: I1014 13:39:07.502575 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" event={"ID":"b5c316a0-59ee-4d79-89f3-198895529796","Type":"ContainerDied","Data":"93fe7c68ce0078bbc56a0fdff22a5739f5a4bf6892d0ae2c657f8a0ee9c9c414"} Oct 14 13:39:07.502796 master-0 kubenswrapper[4807]: I1014 13:39:07.502720 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" event={"ID":"b5c316a0-59ee-4d79-89f3-198895529796","Type":"ContainerStarted","Data":"10b062f03c1723d2d2d869ea0415f11b4457503d072909b69542eccef9156c3c"} Oct 14 13:39:08.513492 master-0 kubenswrapper[4807]: I1014 13:39:08.513386 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" event={"ID":"b5c316a0-59ee-4d79-89f3-198895529796","Type":"ContainerStarted","Data":"f5555a235338f9e7539b3d2c4dd053caae9ea6861ac0aa24c35df59e789ea2a1"} Oct 14 13:39:08.514439 master-0 kubenswrapper[4807]: I1014 13:39:08.513609 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:08.776583 master-0 kubenswrapper[4807]: I1014 13:39:08.776286 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" podStartSLOduration=2.776249929 podStartE2EDuration="2.776249929s" podCreationTimestamp="2025-10-14 13:39:06 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:39:08.775188291 +0000 UTC m=+1143.456490115" watchObservedRunningTime="2025-10-14 13:39:08.776249929 +0000 UTC m=+1143.457551803" Oct 14 13:39:09.526197 master-0 kubenswrapper[4807]: I1014 13:39:09.526059 4807 generic.go:334] "Generic (PLEG): container finished" podID="d84e5841-9c39-4199-9c89-74526741050d" containerID="b88e5a31652b39677e490f548f779bec98ea6745633f28016b027552e3d6bd0b" exitCode=0 Oct 14 13:39:09.526197 master-0 kubenswrapper[4807]: I1014 13:39:09.526148 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerDied","Data":"b88e5a31652b39677e490f548f779bec98ea6745633f28016b027552e3d6bd0b"} Oct 14 13:39:09.654718 master-0 kubenswrapper[4807]: I1014 13:39:09.654653 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:39:09.740048 master-0 kubenswrapper[4807]: I1014 13:39:09.739940 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sn667\" (UniqueName: \"kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667\") pod \"d84e5841-9c39-4199-9c89-74526741050d\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " Oct 14 13:39:09.740249 master-0 kubenswrapper[4807]: I1014 13:39:09.740138 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle\") pod \"d84e5841-9c39-4199-9c89-74526741050d\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " Oct 14 13:39:09.740249 master-0 kubenswrapper[4807]: I1014 13:39:09.740181 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data\") pod \"d84e5841-9c39-4199-9c89-74526741050d\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " Oct 14 13:39:09.740249 master-0 kubenswrapper[4807]: I1014 13:39:09.740236 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs\") pod \"d84e5841-9c39-4199-9c89-74526741050d\" (UID: \"d84e5841-9c39-4199-9c89-74526741050d\") " Oct 14 13:39:09.740988 master-0 kubenswrapper[4807]: I1014 13:39:09.740925 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs" (OuterVolumeSpecName: "logs") pod "d84e5841-9c39-4199-9c89-74526741050d" (UID: "d84e5841-9c39-4199-9c89-74526741050d"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:39:09.745269 master-0 kubenswrapper[4807]: I1014 13:39:09.745211 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667" (OuterVolumeSpecName: "kube-api-access-sn667") pod "d84e5841-9c39-4199-9c89-74526741050d" (UID: "d84e5841-9c39-4199-9c89-74526741050d"). InnerVolumeSpecName "kube-api-access-sn667". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:39:09.763645 master-0 kubenswrapper[4807]: I1014 13:39:09.763565 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data" (OuterVolumeSpecName: "config-data") pod "d84e5841-9c39-4199-9c89-74526741050d" (UID: "d84e5841-9c39-4199-9c89-74526741050d"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:09.769133 master-0 kubenswrapper[4807]: I1014 13:39:09.769029 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "d84e5841-9c39-4199-9c89-74526741050d" (UID: "d84e5841-9c39-4199-9c89-74526741050d"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:09.843308 master-0 kubenswrapper[4807]: I1014 13:39:09.843227 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-sn667\" (UniqueName: \"kubernetes.io/projected/d84e5841-9c39-4199-9c89-74526741050d-kube-api-access-sn667\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:09.843308 master-0 kubenswrapper[4807]: I1014 13:39:09.843297 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:09.843308 master-0 kubenswrapper[4807]: I1014 13:39:09.843313 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/d84e5841-9c39-4199-9c89-74526741050d-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:09.843568 master-0 kubenswrapper[4807]: I1014 13:39:09.843328 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/d84e5841-9c39-4199-9c89-74526741050d-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:10.541781 master-0 kubenswrapper[4807]: I1014 13:39:10.541703 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"d84e5841-9c39-4199-9c89-74526741050d","Type":"ContainerDied","Data":"0de560c5756109da3c5b4331421a42ddf5aaf3e5c2adf794c466de224669d6e0"} Oct 14 13:39:10.542328 master-0 kubenswrapper[4807]: I1014 13:39:10.541803 4807 scope.go:117] "RemoveContainer" containerID="b88e5a31652b39677e490f548f779bec98ea6745633f28016b027552e3d6bd0b" Oct 14 13:39:10.542328 master-0 kubenswrapper[4807]: I1014 13:39:10.541818 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:39:10.564704 master-0 kubenswrapper[4807]: I1014 13:39:10.564655 4807 scope.go:117] "RemoveContainer" containerID="fd3d2986d5003596a60e30f6b335a1985525936e39c1ba8950d48e91dc164b4a" Oct 14 13:39:11.290583 master-0 kubenswrapper[4807]: I1014 13:39:11.290396 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:11.329383 master-0 kubenswrapper[4807]: I1014 13:39:11.329316 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:11.462752 master-0 kubenswrapper[4807]: I1014 13:39:11.462690 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:11.463093 master-0 kubenswrapper[4807]: E1014 13:39:11.463057 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-log" Oct 14 13:39:11.463093 master-0 kubenswrapper[4807]: I1014 13:39:11.463080 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-log" Oct 14 13:39:11.463182 master-0 kubenswrapper[4807]: E1014 13:39:11.463107 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-api" Oct 14 13:39:11.463182 master-0 kubenswrapper[4807]: I1014 13:39:11.463117 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-api" Oct 14 13:39:11.463303 master-0 kubenswrapper[4807]: I1014 13:39:11.463273 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-log" Oct 14 13:39:11.463303 master-0 kubenswrapper[4807]: I1014 13:39:11.463292 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="d84e5841-9c39-4199-9c89-74526741050d" containerName="nova-api-api" Oct 14 13:39:11.464287 master-0 kubenswrapper[4807]: I1014 13:39:11.464254 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:39:11.467770 master-0 kubenswrapper[4807]: I1014 13:39:11.467729 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Oct 14 13:39:11.484223 master-0 kubenswrapper[4807]: I1014 13:39:11.484161 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.484417 master-0 kubenswrapper[4807]: I1014 13:39:11.484257 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbsvs\" (UniqueName: \"kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.484417 master-0 kubenswrapper[4807]: I1014 13:39:11.484325 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.484417 master-0 kubenswrapper[4807]: I1014 13:39:11.484400 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.532405 master-0 kubenswrapper[4807]: I1014 13:39:11.506507 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:11.585685 master-0 kubenswrapper[4807]: I1014 13:39:11.585544 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.585685 master-0 kubenswrapper[4807]: I1014 13:39:11.585625 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-vbsvs\" (UniqueName: \"kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.585685 master-0 kubenswrapper[4807]: I1014 13:39:11.585664 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.586369 master-0 kubenswrapper[4807]: I1014 13:39:11.585720 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.586751 master-0 kubenswrapper[4807]: I1014 13:39:11.586712 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.599759 master-0 kubenswrapper[4807]: I1014 13:39:11.599657 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.600192 master-0 kubenswrapper[4807]: I1014 13:39:11.600134 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.617476 master-0 kubenswrapper[4807]: I1014 13:39:11.617391 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbsvs\" (UniqueName: \"kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs\") pod \"nova-api-1\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " pod="openstack/nova-api-1" Oct 14 13:39:11.784261 master-0 kubenswrapper[4807]: I1014 13:39:11.784200 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:39:12.291288 master-0 kubenswrapper[4807]: I1014 13:39:12.290446 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d84e5841-9c39-4199-9c89-74526741050d" path="/var/lib/kubelet/pods/d84e5841-9c39-4199-9c89-74526741050d/volumes" Oct 14 13:39:12.291547 master-0 kubenswrapper[4807]: I1014 13:39:12.291360 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:39:12.563256 master-0 kubenswrapper[4807]: I1014 13:39:12.563188 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerStarted","Data":"bca6c4b14143f482e2292204c10ea61518b4d4cf1119749a3c24f045c4e9f17b"} Oct 14 13:39:12.563256 master-0 kubenswrapper[4807]: I1014 13:39:12.563253 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerStarted","Data":"246ee09aad7825544c9242a4ac63fde8c8c6ca756e026fe8c6ed68af71bb2355"} Oct 14 13:39:13.585298 master-0 kubenswrapper[4807]: I1014 13:39:13.585224 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerStarted","Data":"c8d0aac748f4e2e3b602d1ca0656cb4c76691c16eaee5e638e6a11c3d3c515be"} Oct 14 13:39:13.678928 master-0 kubenswrapper[4807]: I1014 13:39:13.678743 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-1" podStartSLOduration=2.678723729 podStartE2EDuration="2.678723729s" podCreationTimestamp="2025-10-14 13:39:11 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:39:13.677471217 +0000 UTC m=+1148.358773051" watchObservedRunningTime="2025-10-14 13:39:13.678723729 +0000 UTC m=+1148.360025553" Oct 14 13:39:16.524869 master-0 kubenswrapper[4807]: I1014 13:39:16.524782 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/dnsmasq-dns-559c6f967c-6vxg9" Oct 14 13:39:21.786327 master-0 kubenswrapper[4807]: I1014 13:39:21.786227 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:39:21.786327 master-0 kubenswrapper[4807]: I1014 13:39:21.786329 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:39:22.867883 master-0 kubenswrapper[4807]: I1014 13:39:22.867781 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-log" probeResult="failure" output="Get \"http://10.130.0.126:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:39:22.867883 master-0 kubenswrapper[4807]: I1014 13:39:22.867827 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-api" probeResult="failure" output="Get \"http://10.130.0.126:8774/\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Oct 14 13:39:31.789603 master-0 kubenswrapper[4807]: I1014 13:39:31.789277 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:39:31.790407 master-0 kubenswrapper[4807]: I1014 13:39:31.790322 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:39:31.790407 master-0 kubenswrapper[4807]: I1014 13:39:31.790379 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:39:31.792480 master-0 kubenswrapper[4807]: I1014 13:39:31.792405 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:39:32.776712 master-0 kubenswrapper[4807]: I1014 13:39:32.776641 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:39:32.782372 master-0 kubenswrapper[4807]: I1014 13:39:32.782291 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:39:35.038356 master-0 kubenswrapper[4807]: I1014 13:39:35.038300 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:35.039072 master-0 kubenswrapper[4807]: I1014 13:39:35.038597 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-scheduler-2" podUID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" containerName="nova-scheduler-scheduler" containerID="cri-o://7c544a3e0f1568592da8ae6e2019c20023e21d38fb40e766eaa5ee2cd1ec3ecc" gracePeriod=30 Oct 14 13:39:35.052648 master-0 kubenswrapper[4807]: I1014 13:39:35.052393 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:35.054187 master-0 kubenswrapper[4807]: I1014 13:39:35.054142 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" containerID="cri-o://4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9" gracePeriod=30 Oct 14 13:39:35.054328 master-0 kubenswrapper[4807]: I1014 13:39:35.054235 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" containerID="cri-o://c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e" gracePeriod=30 Oct 14 13:39:35.804886 master-0 kubenswrapper[4807]: I1014 13:39:35.804801 4807 generic.go:334] "Generic (PLEG): container finished" podID="164f5893-11c7-47d5-a442-824eb80e869b" containerID="4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9" exitCode=143 Oct 14 13:39:35.805260 master-0 kubenswrapper[4807]: I1014 13:39:35.804893 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerDied","Data":"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9"} Oct 14 13:39:37.825745 master-0 kubenswrapper[4807]: I1014 13:39:37.825686 4807 generic.go:334] "Generic (PLEG): container finished" podID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" containerID="7c544a3e0f1568592da8ae6e2019c20023e21d38fb40e766eaa5ee2cd1ec3ecc" exitCode=0 Oct 14 13:39:37.826297 master-0 kubenswrapper[4807]: I1014 13:39:37.825756 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"4d2f942d-2f17-4f57-a7bd-cd61f865b850","Type":"ContainerDied","Data":"7c544a3e0f1568592da8ae6e2019c20023e21d38fb40e766eaa5ee2cd1ec3ecc"} Oct 14 13:39:38.187025 master-0 kubenswrapper[4807]: I1014 13:39:38.186950 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.130.0.123:8775/\": read tcp 10.130.0.2:40868->10.130.0.123:8775: read: connection reset by peer" Oct 14 13:39:38.187686 master-0 kubenswrapper[4807]: I1014 13:39:38.187638 4807 prober.go:107] "Probe failed" probeType="Readiness" pod="openstack/nova-metadata-2" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.130.0.123:8775/\": read tcp 10.130.0.2:40870->10.130.0.123:8775: read: connection reset by peer" Oct 14 13:39:38.202357 master-0 kubenswrapper[4807]: I1014 13:39:38.202314 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:39:38.312613 master-0 kubenswrapper[4807]: I1014 13:39:38.312536 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle\") pod \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " Oct 14 13:39:38.312726 master-0 kubenswrapper[4807]: I1014 13:39:38.312629 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfbvw\" (UniqueName: \"kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw\") pod \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " Oct 14 13:39:38.312773 master-0 kubenswrapper[4807]: I1014 13:39:38.312762 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data\") pod \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\" (UID: \"4d2f942d-2f17-4f57-a7bd-cd61f865b850\") " Oct 14 13:39:38.321775 master-0 kubenswrapper[4807]: I1014 13:39:38.321699 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw" (OuterVolumeSpecName: "kube-api-access-lfbvw") pod "4d2f942d-2f17-4f57-a7bd-cd61f865b850" (UID: "4d2f942d-2f17-4f57-a7bd-cd61f865b850"). InnerVolumeSpecName "kube-api-access-lfbvw". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:39:38.337226 master-0 kubenswrapper[4807]: I1014 13:39:38.337157 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "4d2f942d-2f17-4f57-a7bd-cd61f865b850" (UID: "4d2f942d-2f17-4f57-a7bd-cd61f865b850"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:38.346194 master-0 kubenswrapper[4807]: I1014 13:39:38.346083 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data" (OuterVolumeSpecName: "config-data") pod "4d2f942d-2f17-4f57-a7bd-cd61f865b850" (UID: "4d2f942d-2f17-4f57-a7bd-cd61f865b850"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:38.422414 master-0 kubenswrapper[4807]: I1014 13:39:38.422201 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:38.422764 master-0 kubenswrapper[4807]: I1014 13:39:38.422452 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-lfbvw\" (UniqueName: \"kubernetes.io/projected/4d2f942d-2f17-4f57-a7bd-cd61f865b850-kube-api-access-lfbvw\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:38.422764 master-0 kubenswrapper[4807]: I1014 13:39:38.422493 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4d2f942d-2f17-4f57-a7bd-cd61f865b850-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:38.773080 master-0 kubenswrapper[4807]: I1014 13:39:38.773005 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.851925 4807 generic.go:334] "Generic (PLEG): container finished" podID="164f5893-11c7-47d5-a442-824eb80e869b" containerID="c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e" exitCode=0 Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.852012 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.852010 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerDied","Data":"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e"} Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.852244 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"164f5893-11c7-47d5-a442-824eb80e869b","Type":"ContainerDied","Data":"f348312902a9b3f7b06945cf7a32b4ee1ad05c67a1cfa48d7c8069fd490fd3d2"} Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.852308 4807 scope.go:117] "RemoveContainer" containerID="c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e" Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.853735 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"4d2f942d-2f17-4f57-a7bd-cd61f865b850","Type":"ContainerDied","Data":"66d4edb3698be6324f23e7fe77b10165780716ca0cad803491e75e5207d6002d"} Oct 14 13:39:38.854563 master-0 kubenswrapper[4807]: I1014 13:39:38.853855 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:39:38.879661 master-0 kubenswrapper[4807]: I1014 13:39:38.874901 4807 scope.go:117] "RemoveContainer" containerID="4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9" Oct 14 13:39:38.922070 master-0 kubenswrapper[4807]: I1014 13:39:38.921629 4807 scope.go:117] "RemoveContainer" containerID="c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e" Oct 14 13:39:38.923067 master-0 kubenswrapper[4807]: E1014 13:39:38.922982 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e\": container with ID starting with c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e not found: ID does not exist" containerID="c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e" Oct 14 13:39:38.923171 master-0 kubenswrapper[4807]: I1014 13:39:38.923123 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e"} err="failed to get container status \"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e\": rpc error: code = NotFound desc = could not find container \"c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e\": container with ID starting with c98fadd8af89554f594f998a0f6246e6c260126cfb72cd4bdb90407a13ba7c6e not found: ID does not exist" Oct 14 13:39:38.923292 master-0 kubenswrapper[4807]: I1014 13:39:38.923175 4807 scope.go:117] "RemoveContainer" containerID="4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9" Oct 14 13:39:38.926244 master-0 kubenswrapper[4807]: E1014 13:39:38.924568 4807 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9\": container with ID starting with 4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9 not found: ID does not exist" containerID="4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9" Oct 14 13:39:38.926244 master-0 kubenswrapper[4807]: I1014 13:39:38.924672 4807 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9"} err="failed to get container status \"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9\": rpc error: code = NotFound desc = could not find container \"4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9\": container with ID starting with 4b5d9a09ef2c443f0fb68466061f4ef273cf07347525063102107f0ad9231fe9 not found: ID does not exist" Oct 14 13:39:38.926244 master-0 kubenswrapper[4807]: I1014 13:39:38.924735 4807 scope.go:117] "RemoveContainer" containerID="7c544a3e0f1568592da8ae6e2019c20023e21d38fb40e766eaa5ee2cd1ec3ecc" Oct 14 13:39:38.933093 master-0 kubenswrapper[4807]: I1014 13:39:38.933034 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2g27\" (UniqueName: \"kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27\") pod \"164f5893-11c7-47d5-a442-824eb80e869b\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " Oct 14 13:39:38.933347 master-0 kubenswrapper[4807]: I1014 13:39:38.933201 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle\") pod \"164f5893-11c7-47d5-a442-824eb80e869b\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " Oct 14 13:39:38.933708 master-0 kubenswrapper[4807]: I1014 13:39:38.933685 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs\") pod \"164f5893-11c7-47d5-a442-824eb80e869b\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " Oct 14 13:39:38.933774 master-0 kubenswrapper[4807]: I1014 13:39:38.933752 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data\") pod \"164f5893-11c7-47d5-a442-824eb80e869b\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " Oct 14 13:39:38.933817 master-0 kubenswrapper[4807]: I1014 13:39:38.933798 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs\") pod \"164f5893-11c7-47d5-a442-824eb80e869b\" (UID: \"164f5893-11c7-47d5-a442-824eb80e869b\") " Oct 14 13:39:38.934335 master-0 kubenswrapper[4807]: I1014 13:39:38.934267 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs" (OuterVolumeSpecName: "logs") pod "164f5893-11c7-47d5-a442-824eb80e869b" (UID: "164f5893-11c7-47d5-a442-824eb80e869b"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:39:38.937850 master-0 kubenswrapper[4807]: I1014 13:39:38.937791 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:38.940269 master-0 kubenswrapper[4807]: I1014 13:39:38.939937 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27" (OuterVolumeSpecName: "kube-api-access-n2g27") pod "164f5893-11c7-47d5-a442-824eb80e869b" (UID: "164f5893-11c7-47d5-a442-824eb80e869b"). InnerVolumeSpecName "kube-api-access-n2g27". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:39:38.955372 master-0 kubenswrapper[4807]: I1014 13:39:38.955314 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:38.962665 master-0 kubenswrapper[4807]: I1014 13:39:38.962588 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data" (OuterVolumeSpecName: "config-data") pod "164f5893-11c7-47d5-a442-824eb80e869b" (UID: "164f5893-11c7-47d5-a442-824eb80e869b"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:38.966537 master-0 kubenswrapper[4807]: I1014 13:39:38.966314 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:38.966639 master-0 kubenswrapper[4807]: I1014 13:39:38.966573 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "164f5893-11c7-47d5-a442-824eb80e869b" (UID: "164f5893-11c7-47d5-a442-824eb80e869b"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:38.967003 master-0 kubenswrapper[4807]: E1014 13:39:38.966956 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" Oct 14 13:39:38.967003 master-0 kubenswrapper[4807]: I1014 13:39:38.966999 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" Oct 14 13:39:38.967083 master-0 kubenswrapper[4807]: E1014 13:39:38.967041 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" Oct 14 13:39:38.967083 master-0 kubenswrapper[4807]: I1014 13:39:38.967055 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" Oct 14 13:39:38.967083 master-0 kubenswrapper[4807]: E1014 13:39:38.967081 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" containerName="nova-scheduler-scheduler" Oct 14 13:39:38.967197 master-0 kubenswrapper[4807]: I1014 13:39:38.967096 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" containerName="nova-scheduler-scheduler" Oct 14 13:39:38.967427 master-0 kubenswrapper[4807]: I1014 13:39:38.967391 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-metadata" Oct 14 13:39:38.967497 master-0 kubenswrapper[4807]: I1014 13:39:38.967432 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" containerName="nova-scheduler-scheduler" Oct 14 13:39:38.967545 master-0 kubenswrapper[4807]: I1014 13:39:38.967500 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="164f5893-11c7-47d5-a442-824eb80e869b" containerName="nova-metadata-log" Oct 14 13:39:38.968863 master-0 kubenswrapper[4807]: I1014 13:39:38.968823 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:39:38.971777 master-0 kubenswrapper[4807]: I1014 13:39:38.971740 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-scheduler-config-data" Oct 14 13:39:38.986223 master-0 kubenswrapper[4807]: I1014 13:39:38.986131 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:38.987173 master-0 kubenswrapper[4807]: I1014 13:39:38.987093 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs" (OuterVolumeSpecName: "nova-metadata-tls-certs") pod "164f5893-11c7-47d5-a442-824eb80e869b" (UID: "164f5893-11c7-47d5-a442-824eb80e869b"). InnerVolumeSpecName "nova-metadata-tls-certs". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:39:39.035710 master-0 kubenswrapper[4807]: I1014 13:39:39.035637 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-config-data\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.035986 master-0 kubenswrapper[4807]: I1014 13:39:39.035769 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vtkb\" (UniqueName: \"kubernetes.io/projected/f81e99eb-e3bc-4354-a5ea-d4e384f909be-kube-api-access-7vtkb\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.036240 master-0 kubenswrapper[4807]: I1014 13:39:39.036212 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.036317 master-0 kubenswrapper[4807]: I1014 13:39:39.036296 4807 reconciler_common.go:293] "Volume detached for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-nova-metadata-tls-certs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:39.036375 master-0 kubenswrapper[4807]: I1014 13:39:39.036319 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-n2g27\" (UniqueName: \"kubernetes.io/projected/164f5893-11c7-47d5-a442-824eb80e869b-kube-api-access-n2g27\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:39.036375 master-0 kubenswrapper[4807]: I1014 13:39:39.036333 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:39.036375 master-0 kubenswrapper[4807]: I1014 13:39:39.036345 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/164f5893-11c7-47d5-a442-824eb80e869b-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:39.036375 master-0 kubenswrapper[4807]: I1014 13:39:39.036358 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/164f5893-11c7-47d5-a442-824eb80e869b-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:39:39.138333 master-0 kubenswrapper[4807]: I1014 13:39:39.138228 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.138333 master-0 kubenswrapper[4807]: I1014 13:39:39.138327 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-config-data\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.138755 master-0 kubenswrapper[4807]: I1014 13:39:39.138387 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7vtkb\" (UniqueName: \"kubernetes.io/projected/f81e99eb-e3bc-4354-a5ea-d4e384f909be-kube-api-access-7vtkb\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.142518 master-0 kubenswrapper[4807]: I1014 13:39:39.142442 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-config-data\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.143068 master-0 kubenswrapper[4807]: I1014 13:39:39.143008 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f81e99eb-e3bc-4354-a5ea-d4e384f909be-combined-ca-bundle\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.167481 master-0 kubenswrapper[4807]: I1014 13:39:39.167230 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vtkb\" (UniqueName: \"kubernetes.io/projected/f81e99eb-e3bc-4354-a5ea-d4e384f909be-kube-api-access-7vtkb\") pod \"nova-scheduler-2\" (UID: \"f81e99eb-e3bc-4354-a5ea-d4e384f909be\") " pod="openstack/nova-scheduler-2" Oct 14 13:39:39.206820 master-0 kubenswrapper[4807]: I1014 13:39:39.206590 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:39.216616 master-0 kubenswrapper[4807]: I1014 13:39:39.216533 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:39.242352 master-0 kubenswrapper[4807]: I1014 13:39:39.242246 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:39.245163 master-0 kubenswrapper[4807]: I1014 13:39:39.243708 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:39:39.247535 master-0 kubenswrapper[4807]: I1014 13:39:39.247477 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-metadata-config-data" Oct 14 13:39:39.248660 master-0 kubenswrapper[4807]: I1014 13:39:39.248614 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-metadata-internal-svc" Oct 14 13:39:39.261744 master-0 kubenswrapper[4807]: I1014 13:39:39.261686 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:39.368604 master-0 kubenswrapper[4807]: I1014 13:39:39.363774 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-scheduler-2" Oct 14 13:39:39.451624 master-0 kubenswrapper[4807]: I1014 13:39:39.451546 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6wlf\" (UniqueName: \"kubernetes.io/projected/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-kube-api-access-f6wlf\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.451757 master-0 kubenswrapper[4807]: I1014 13:39:39.451696 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-config-data\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.455967 master-0 kubenswrapper[4807]: I1014 13:39:39.455922 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.456176 master-0 kubenswrapper[4807]: I1014 13:39:39.456135 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-logs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.456258 master-0 kubenswrapper[4807]: I1014 13:39:39.456227 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.558404 master-0 kubenswrapper[4807]: I1014 13:39:39.558323 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-f6wlf\" (UniqueName: \"kubernetes.io/projected/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-kube-api-access-f6wlf\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.558404 master-0 kubenswrapper[4807]: I1014 13:39:39.558397 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-config-data\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.558806 master-0 kubenswrapper[4807]: I1014 13:39:39.558479 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.558806 master-0 kubenswrapper[4807]: I1014 13:39:39.558523 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-logs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.558806 master-0 kubenswrapper[4807]: I1014 13:39:39.558548 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.559321 master-0 kubenswrapper[4807]: I1014 13:39:39.559269 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-logs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.562600 master-0 kubenswrapper[4807]: I1014 13:39:39.562543 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"nova-metadata-tls-certs\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-nova-metadata-tls-certs\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.563176 master-0 kubenswrapper[4807]: I1014 13:39:39.563109 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-config-data\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.567250 master-0 kubenswrapper[4807]: I1014 13:39:39.567179 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-combined-ca-bundle\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.588200 master-0 kubenswrapper[4807]: I1014 13:39:39.588154 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6wlf\" (UniqueName: \"kubernetes.io/projected/dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67-kube-api-access-f6wlf\") pod \"nova-metadata-2\" (UID: \"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67\") " pod="openstack/nova-metadata-2" Oct 14 13:39:39.827489 master-0 kubenswrapper[4807]: I1014 13:39:39.827429 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-scheduler-2"] Oct 14 13:39:39.833709 master-0 kubenswrapper[4807]: W1014 13:39:39.833659 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf81e99eb_e3bc_4354_a5ea_d4e384f909be.slice/crio-80b4582f39c8313c7015ead1cc6c1a9e97db5ee806d71300ada2226e734af57c WatchSource:0}: Error finding container 80b4582f39c8313c7015ead1cc6c1a9e97db5ee806d71300ada2226e734af57c: Status 404 returned error can't find the container with id 80b4582f39c8313c7015ead1cc6c1a9e97db5ee806d71300ada2226e734af57c Oct 14 13:39:39.867159 master-0 kubenswrapper[4807]: I1014 13:39:39.867109 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"f81e99eb-e3bc-4354-a5ea-d4e384f909be","Type":"ContainerStarted","Data":"80b4582f39c8313c7015ead1cc6c1a9e97db5ee806d71300ada2226e734af57c"} Oct 14 13:39:39.870069 master-0 kubenswrapper[4807]: I1014 13:39:39.870036 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-metadata-2" Oct 14 13:39:40.278588 master-0 kubenswrapper[4807]: I1014 13:39:40.276853 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="164f5893-11c7-47d5-a442-824eb80e869b" path="/var/lib/kubelet/pods/164f5893-11c7-47d5-a442-824eb80e869b/volumes" Oct 14 13:39:40.278588 master-0 kubenswrapper[4807]: I1014 13:39:40.277659 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d2f942d-2f17-4f57-a7bd-cd61f865b850" path="/var/lib/kubelet/pods/4d2f942d-2f17-4f57-a7bd-cd61f865b850/volumes" Oct 14 13:39:40.412445 master-0 kubenswrapper[4807]: I1014 13:39:40.412354 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-metadata-2"] Oct 14 13:39:40.887136 master-0 kubenswrapper[4807]: I1014 13:39:40.887072 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67","Type":"ContainerStarted","Data":"eb1485e8ed9f4560d6cb6b7ad25da98c44f53f04a9d7937cdf086d32717a4607"} Oct 14 13:39:40.887136 master-0 kubenswrapper[4807]: I1014 13:39:40.887128 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67","Type":"ContainerStarted","Data":"95267786f7fa9587e36c3bdab27d524ae6bdbbc9a2ec50152bca082209b11ba5"} Oct 14 13:39:40.887136 master-0 kubenswrapper[4807]: I1014 13:39:40.887146 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-metadata-2" event={"ID":"dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67","Type":"ContainerStarted","Data":"b12bd4c66af6bf5ac4444df81ef19fa53ab3372a3b23ce212857203b7b33d33e"} Oct 14 13:39:40.889791 master-0 kubenswrapper[4807]: I1014 13:39:40.889761 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-scheduler-2" event={"ID":"f81e99eb-e3bc-4354-a5ea-d4e384f909be","Type":"ContainerStarted","Data":"7293271edaeb010fcc356705a0f411e8024ef9156780b6d4d9ced2fda1358b59"} Oct 14 13:39:40.915186 master-0 kubenswrapper[4807]: I1014 13:39:40.915091 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-metadata-2" podStartSLOduration=1.9150638880000002 podStartE2EDuration="1.915063888s" podCreationTimestamp="2025-10-14 13:39:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:39:40.913625421 +0000 UTC m=+1175.594927265" watchObservedRunningTime="2025-10-14 13:39:40.915063888 +0000 UTC m=+1175.596365712" Oct 14 13:39:40.952761 master-0 kubenswrapper[4807]: I1014 13:39:40.952589 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-scheduler-2" podStartSLOduration=2.95256408 podStartE2EDuration="2.95256408s" podCreationTimestamp="2025-10-14 13:39:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:39:40.939262659 +0000 UTC m=+1175.620564503" watchObservedRunningTime="2025-10-14 13:39:40.95256408 +0000 UTC m=+1175.633865914" Oct 14 13:39:44.365715 master-0 kubenswrapper[4807]: I1014 13:39:44.365587 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-scheduler-2" Oct 14 13:39:44.870964 master-0 kubenswrapper[4807]: I1014 13:39:44.870352 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:39:44.870964 master-0 kubenswrapper[4807]: I1014 13:39:44.870439 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-metadata-2" Oct 14 13:39:49.365412 master-0 kubenswrapper[4807]: I1014 13:39:49.365327 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-scheduler-2" Oct 14 13:39:49.404301 master-0 kubenswrapper[4807]: I1014 13:39:49.404196 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-scheduler-2" Oct 14 13:39:49.871318 master-0 kubenswrapper[4807]: I1014 13:39:49.871229 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-2" Oct 14 13:39:49.871318 master-0 kubenswrapper[4807]: I1014 13:39:49.871318 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-metadata-2" Oct 14 13:39:50.011129 master-0 kubenswrapper[4807]: I1014 13:39:50.011035 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-scheduler-2" Oct 14 13:39:50.902163 master-0 kubenswrapper[4807]: I1014 13:39:50.901734 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-2" podUID="dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67" containerName="nova-metadata-metadata" probeResult="failure" output="Get \"https://10.130.0.128:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:39:50.902163 master-0 kubenswrapper[4807]: I1014 13:39:50.901734 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-metadata-2" podUID="dc6dcdd4-8ccc-4c4d-b2c1-bdddabda1a67" containerName="nova-metadata-log" probeResult="failure" output="Get \"https://10.130.0.128:8775/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:39:59.883122 master-0 kubenswrapper[4807]: I1014 13:39:59.883026 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-2" Oct 14 13:39:59.886816 master-0 kubenswrapper[4807]: I1014 13:39:59.886754 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-metadata-2" Oct 14 13:39:59.889438 master-0 kubenswrapper[4807]: I1014 13:39:59.889393 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-2" Oct 14 13:40:00.085154 master-0 kubenswrapper[4807]: I1014 13:40:00.085066 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-metadata-2" Oct 14 13:40:00.499696 master-0 kubenswrapper[4807]: I1014 13:40:00.498801 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:00.499696 master-0 kubenswrapper[4807]: I1014 13:40:00.499132 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-1" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-log" containerID="cri-o://bca6c4b14143f482e2292204c10ea61518b4d4cf1119749a3c24f045c4e9f17b" gracePeriod=30 Oct 14 13:40:00.500190 master-0 kubenswrapper[4807]: I1014 13:40:00.499748 4807 kuberuntime_container.go:808] "Killing container with a grace period" pod="openstack/nova-api-1" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-api" containerID="cri-o://c8d0aac748f4e2e3b602d1ca0656cb4c76691c16eaee5e638e6a11c3d3c515be" gracePeriod=30 Oct 14 13:40:01.090677 master-0 kubenswrapper[4807]: I1014 13:40:01.090614 4807 generic.go:334] "Generic (PLEG): container finished" podID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerID="bca6c4b14143f482e2292204c10ea61518b4d4cf1119749a3c24f045c4e9f17b" exitCode=143 Oct 14 13:40:01.091291 master-0 kubenswrapper[4807]: I1014 13:40:01.090713 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerDied","Data":"bca6c4b14143f482e2292204c10ea61518b4d4cf1119749a3c24f045c4e9f17b"} Oct 14 13:40:04.122293 master-0 kubenswrapper[4807]: I1014 13:40:04.122217 4807 generic.go:334] "Generic (PLEG): container finished" podID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerID="c8d0aac748f4e2e3b602d1ca0656cb4c76691c16eaee5e638e6a11c3d3c515be" exitCode=0 Oct 14 13:40:04.122293 master-0 kubenswrapper[4807]: I1014 13:40:04.122289 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerDied","Data":"c8d0aac748f4e2e3b602d1ca0656cb4c76691c16eaee5e638e6a11c3d3c515be"} Oct 14 13:40:04.220652 master-0 kubenswrapper[4807]: I1014 13:40:04.220590 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:40:04.283683 master-0 kubenswrapper[4807]: I1014 13:40:04.283603 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data\") pod \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " Oct 14 13:40:04.283683 master-0 kubenswrapper[4807]: I1014 13:40:04.283692 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle\") pod \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " Oct 14 13:40:04.284076 master-0 kubenswrapper[4807]: I1014 13:40:04.283790 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbsvs\" (UniqueName: \"kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs\") pod \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " Oct 14 13:40:04.284076 master-0 kubenswrapper[4807]: I1014 13:40:04.284056 4807 reconciler_common.go:159] "operationExecutor.UnmountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs\") pod \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\" (UID: \"f521d60f-6570-4d18-b4fe-de5892bf2ac6\") " Oct 14 13:40:04.286147 master-0 kubenswrapper[4807]: I1014 13:40:04.285667 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs" (OuterVolumeSpecName: "logs") pod "f521d60f-6570-4d18-b4fe-de5892bf2ac6" (UID: "f521d60f-6570-4d18-b4fe-de5892bf2ac6"). InnerVolumeSpecName "logs". PluginName "kubernetes.io/empty-dir", VolumeGidValue "" Oct 14 13:40:04.292338 master-0 kubenswrapper[4807]: I1014 13:40:04.292254 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs" (OuterVolumeSpecName: "kube-api-access-vbsvs") pod "f521d60f-6570-4d18-b4fe-de5892bf2ac6" (UID: "f521d60f-6570-4d18-b4fe-de5892bf2ac6"). InnerVolumeSpecName "kube-api-access-vbsvs". PluginName "kubernetes.io/projected", VolumeGidValue "" Oct 14 13:40:04.310010 master-0 kubenswrapper[4807]: I1014 13:40:04.309935 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle" (OuterVolumeSpecName: "combined-ca-bundle") pod "f521d60f-6570-4d18-b4fe-de5892bf2ac6" (UID: "f521d60f-6570-4d18-b4fe-de5892bf2ac6"). InnerVolumeSpecName "combined-ca-bundle". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:40:04.320021 master-0 kubenswrapper[4807]: I1014 13:40:04.319935 4807 operation_generator.go:803] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data" (OuterVolumeSpecName: "config-data") pod "f521d60f-6570-4d18-b4fe-de5892bf2ac6" (UID: "f521d60f-6570-4d18-b4fe-de5892bf2ac6"). InnerVolumeSpecName "config-data". PluginName "kubernetes.io/secret", VolumeGidValue "" Oct 14 13:40:04.387785 master-0 kubenswrapper[4807]: I1014 13:40:04.387576 4807 reconciler_common.go:293] "Volume detached for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-config-data\") on node \"master-0\" DevicePath \"\"" Oct 14 13:40:04.387785 master-0 kubenswrapper[4807]: I1014 13:40:04.387623 4807 reconciler_common.go:293] "Volume detached for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f521d60f-6570-4d18-b4fe-de5892bf2ac6-combined-ca-bundle\") on node \"master-0\" DevicePath \"\"" Oct 14 13:40:04.387785 master-0 kubenswrapper[4807]: I1014 13:40:04.387637 4807 reconciler_common.go:293] "Volume detached for volume \"kube-api-access-vbsvs\" (UniqueName: \"kubernetes.io/projected/f521d60f-6570-4d18-b4fe-de5892bf2ac6-kube-api-access-vbsvs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:40:04.387785 master-0 kubenswrapper[4807]: I1014 13:40:04.387649 4807 reconciler_common.go:293] "Volume detached for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/f521d60f-6570-4d18-b4fe-de5892bf2ac6-logs\") on node \"master-0\" DevicePath \"\"" Oct 14 13:40:05.139521 master-0 kubenswrapper[4807]: I1014 13:40:05.139394 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"f521d60f-6570-4d18-b4fe-de5892bf2ac6","Type":"ContainerDied","Data":"246ee09aad7825544c9242a4ac63fde8c8c6ca756e026fe8c6ed68af71bb2355"} Oct 14 13:40:05.139521 master-0 kubenswrapper[4807]: I1014 13:40:05.139533 4807 scope.go:117] "RemoveContainer" containerID="c8d0aac748f4e2e3b602d1ca0656cb4c76691c16eaee5e638e6a11c3d3c515be" Oct 14 13:40:05.140701 master-0 kubenswrapper[4807]: I1014 13:40:05.139549 4807 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:40:05.171100 master-0 kubenswrapper[4807]: I1014 13:40:05.167169 4807 scope.go:117] "RemoveContainer" containerID="bca6c4b14143f482e2292204c10ea61518b4d4cf1119749a3c24f045c4e9f17b" Oct 14 13:40:05.187568 master-0 kubenswrapper[4807]: I1014 13:40:05.185780 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:05.194271 master-0 kubenswrapper[4807]: I1014 13:40:05.194199 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:05.225372 master-0 kubenswrapper[4807]: I1014 13:40:05.225294 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:05.225874 master-0 kubenswrapper[4807]: E1014 13:40:05.225846 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-log" Oct 14 13:40:05.225950 master-0 kubenswrapper[4807]: I1014 13:40:05.225875 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-log" Oct 14 13:40:05.225950 master-0 kubenswrapper[4807]: E1014 13:40:05.225904 4807 cpu_manager.go:410] "RemoveStaleState: removing container" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-api" Oct 14 13:40:05.225950 master-0 kubenswrapper[4807]: I1014 13:40:05.225914 4807 state_mem.go:107] "Deleted CPUSet assignment" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-api" Oct 14 13:40:05.226122 master-0 kubenswrapper[4807]: I1014 13:40:05.226096 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-log" Oct 14 13:40:05.226279 master-0 kubenswrapper[4807]: I1014 13:40:05.226135 4807 memory_manager.go:354] "RemoveStaleState removing state" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" containerName="nova-api-api" Oct 14 13:40:05.227534 master-0 kubenswrapper[4807]: I1014 13:40:05.227498 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:40:05.230858 master-0 kubenswrapper[4807]: I1014 13:40:05.230690 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-public-svc" Oct 14 13:40:05.230961 master-0 kubenswrapper[4807]: I1014 13:40:05.230885 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"cert-nova-internal-svc" Oct 14 13:40:05.231115 master-0 kubenswrapper[4807]: I1014 13:40:05.231092 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"nova-api-config-data" Oct 14 13:40:05.240713 master-0 kubenswrapper[4807]: I1014 13:40:05.240640 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:05.310049 master-0 kubenswrapper[4807]: I1014 13:40:05.309988 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-public-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.310293 master-0 kubenswrapper[4807]: I1014 13:40:05.310070 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/462a06e7-6543-492c-a8ab-be59e1e05cc1-logs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.310293 master-0 kubenswrapper[4807]: I1014 13:40:05.310142 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.310293 master-0 kubenswrapper[4807]: I1014 13:40:05.310259 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-config-data\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.310439 master-0 kubenswrapper[4807]: I1014 13:40:05.310294 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnqhq\" (UniqueName: \"kubernetes.io/projected/462a06e7-6543-492c-a8ab-be59e1e05cc1-kube-api-access-dnqhq\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.310439 master-0 kubenswrapper[4807]: I1014 13:40:05.310372 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-internal-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.412164 master-0 kubenswrapper[4807]: I1014 13:40:05.411996 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-internal-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.412164 master-0 kubenswrapper[4807]: I1014 13:40:05.412071 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-public-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.412164 master-0 kubenswrapper[4807]: I1014 13:40:05.412116 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/462a06e7-6543-492c-a8ab-be59e1e05cc1-logs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.412164 master-0 kubenswrapper[4807]: I1014 13:40:05.412164 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.412738 master-0 kubenswrapper[4807]: I1014 13:40:05.412198 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-config-data\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.413032 master-0 kubenswrapper[4807]: I1014 13:40:05.412945 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-dnqhq\" (UniqueName: \"kubernetes.io/projected/462a06e7-6543-492c-a8ab-be59e1e05cc1-kube-api-access-dnqhq\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.413448 master-0 kubenswrapper[4807]: I1014 13:40:05.413034 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"logs\" (UniqueName: \"kubernetes.io/empty-dir/462a06e7-6543-492c-a8ab-be59e1e05cc1-logs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.417048 master-0 kubenswrapper[4807]: I1014 13:40:05.416945 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"internal-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-internal-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.418133 master-0 kubenswrapper[4807]: I1014 13:40:05.418080 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-config-data\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.421158 master-0 kubenswrapper[4807]: I1014 13:40:05.421074 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"public-tls-certs\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-public-tls-certs\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.421323 master-0 kubenswrapper[4807]: I1014 13:40:05.421161 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/462a06e7-6543-492c-a8ab-be59e1e05cc1-combined-ca-bundle\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.435753 master-0 kubenswrapper[4807]: I1014 13:40:05.435678 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnqhq\" (UniqueName: \"kubernetes.io/projected/462a06e7-6543-492c-a8ab-be59e1e05cc1-kube-api-access-dnqhq\") pod \"nova-api-1\" (UID: \"462a06e7-6543-492c-a8ab-be59e1e05cc1\") " pod="openstack/nova-api-1" Oct 14 13:40:05.550834 master-0 kubenswrapper[4807]: I1014 13:40:05.550626 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/nova-api-1" Oct 14 13:40:06.018332 master-0 kubenswrapper[4807]: I1014 13:40:06.018106 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/nova-api-1"] Oct 14 13:40:06.156356 master-0 kubenswrapper[4807]: I1014 13:40:06.156292 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"462a06e7-6543-492c-a8ab-be59e1e05cc1","Type":"ContainerStarted","Data":"f3b4c16c86d020464737bf9702988fe15480bb7b7680cce408b383d251a1720d"} Oct 14 13:40:06.273138 master-0 kubenswrapper[4807]: I1014 13:40:06.273077 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f521d60f-6570-4d18-b4fe-de5892bf2ac6" path="/var/lib/kubelet/pods/f521d60f-6570-4d18-b4fe-de5892bf2ac6/volumes" Oct 14 13:40:07.169282 master-0 kubenswrapper[4807]: I1014 13:40:07.169191 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"462a06e7-6543-492c-a8ab-be59e1e05cc1","Type":"ContainerStarted","Data":"1df081cb26fb75548b3330254d58e4be6a5b59b627d6b658ff60f7fd3e581f31"} Oct 14 13:40:07.169282 master-0 kubenswrapper[4807]: I1014 13:40:07.169255 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/nova-api-1" event={"ID":"462a06e7-6543-492c-a8ab-be59e1e05cc1","Type":"ContainerStarted","Data":"6513f76a55c18bb1295a8b986eafb5dd33997e17a21b50f512a73c8b32ab13f3"} Oct 14 13:40:07.209839 master-0 kubenswrapper[4807]: I1014 13:40:07.209726 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/nova-api-1" podStartSLOduration=2.209704607 podStartE2EDuration="2.209704607s" podCreationTimestamp="2025-10-14 13:40:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:40:07.202495482 +0000 UTC m=+1201.883797376" watchObservedRunningTime="2025-10-14 13:40:07.209704607 +0000 UTC m=+1201.891006431" Oct 14 13:40:15.551201 master-0 kubenswrapper[4807]: I1014 13:40:15.551151 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:40:15.551201 master-0 kubenswrapper[4807]: I1014 13:40:15.551209 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openstack/nova-api-1" Oct 14 13:40:16.565988 master-0 kubenswrapper[4807]: I1014 13:40:16.565723 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="462a06e7-6543-492c-a8ab-be59e1e05cc1" containerName="nova-api-api" probeResult="failure" output="Get \"https://10.130.0.129:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:40:16.566667 master-0 kubenswrapper[4807]: I1014 13:40:16.565782 4807 prober.go:107] "Probe failed" probeType="Startup" pod="openstack/nova-api-1" podUID="462a06e7-6543-492c-a8ab-be59e1e05cc1" containerName="nova-api-log" probeResult="failure" output="Get \"https://10.130.0.129:8774/\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)" Oct 14 13:40:25.558282 master-0 kubenswrapper[4807]: I1014 13:40:25.558201 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:40:25.559760 master-0 kubenswrapper[4807]: I1014 13:40:25.559477 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:40:25.559985 master-0 kubenswrapper[4807]: I1014 13:40:25.559954 4807 kubelet.go:2542] "SyncLoop (probe)" probe="startup" status="started" pod="openstack/nova-api-1" Oct 14 13:40:25.565214 master-0 kubenswrapper[4807]: I1014 13:40:25.565169 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:40:26.375098 master-0 kubenswrapper[4807]: I1014 13:40:26.374171 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/nova-api-1" Oct 14 13:40:26.388273 master-0 kubenswrapper[4807]: I1014 13:40:26.384633 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/nova-api-1" Oct 14 13:41:13.660526 master-0 kubenswrapper[4807]: I1014 13:41:13.660444 4807 scope.go:117] "RemoveContainer" containerID="e5e444f0ca2fd980bc433b0546caa8cfb5494ad33d44d3cc3496e78aed8ebd4e" Oct 14 13:41:13.687437 master-0 kubenswrapper[4807]: I1014 13:41:13.687381 4807 scope.go:117] "RemoveContainer" containerID="f129ba3b234a24a9377030e5d280eb222b6ed607d0ee5fac0648abbb7a7c8f50" Oct 14 13:41:13.721975 master-0 kubenswrapper[4807]: I1014 13:41:13.721910 4807 scope.go:117] "RemoveContainer" containerID="81da5068d73284bec2acdbe49db063e23ed78ab9029a1e924b2cf0da438f1fd5" Oct 14 13:41:13.740701 master-0 kubenswrapper[4807]: I1014 13:41:13.740648 4807 scope.go:117] "RemoveContainer" containerID="f452ef707be015c051014ebbed79d626132ab7be5903d6179d9ce81b7160f330" Oct 14 13:41:18.163796 master-0 kubenswrapper[4807]: I1014 13:41:18.163697 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/octavia-rsyslog-d7l26"] Oct 14 13:41:18.165451 master-0 kubenswrapper[4807]: I1014 13:41:18.165415 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.168257 master-0 kubenswrapper[4807]: I1014 13:41:18.168210 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-rsyslog-scripts" Oct 14 13:41:18.168515 master-0 kubenswrapper[4807]: I1014 13:41:18.168429 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openstack"/"octavia-hmport-map" Oct 14 13:41:18.169435 master-0 kubenswrapper[4807]: I1014 13:41:18.169396 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-rsyslog-config-data" Oct 14 13:41:18.182806 master-0 kubenswrapper[4807]: I1014 13:41:18.182712 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-rsyslog-d7l26"] Oct 14 13:41:18.323340 master-0 kubenswrapper[4807]: I1014 13:41:18.323256 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-config-data\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.323340 master-0 kubenswrapper[4807]: I1014 13:41:18.323338 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/3002395e-511a-4ab7-b04f-259785cbaebf-config-data-merged\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.323732 master-0 kubenswrapper[4807]: I1014 13:41:18.323670 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/3002395e-511a-4ab7-b04f-259785cbaebf-hm-ports\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.323814 master-0 kubenswrapper[4807]: I1014 13:41:18.323782 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-scripts\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.436125 master-0 kubenswrapper[4807]: I1014 13:41:18.435950 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-config-data\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.436125 master-0 kubenswrapper[4807]: I1014 13:41:18.436096 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/3002395e-511a-4ab7-b04f-259785cbaebf-config-data-merged\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.436421 master-0 kubenswrapper[4807]: I1014 13:41:18.436231 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/3002395e-511a-4ab7-b04f-259785cbaebf-hm-ports\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.436421 master-0 kubenswrapper[4807]: I1014 13:41:18.436330 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-scripts\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.446647 master-0 kubenswrapper[4807]: I1014 13:41:18.446593 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/3002395e-511a-4ab7-b04f-259785cbaebf-config-data-merged\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.448025 master-0 kubenswrapper[4807]: I1014 13:41:18.447968 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/3002395e-511a-4ab7-b04f-259785cbaebf-hm-ports\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.450703 master-0 kubenswrapper[4807]: I1014 13:41:18.450629 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-config-data\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.452230 master-0 kubenswrapper[4807]: I1014 13:41:18.452190 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/3002395e-511a-4ab7-b04f-259785cbaebf-scripts\") pod \"octavia-rsyslog-d7l26\" (UID: \"3002395e-511a-4ab7-b04f-259785cbaebf\") " pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:18.482183 master-0 kubenswrapper[4807]: I1014 13:41:18.482129 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:19.242590 master-0 kubenswrapper[4807]: I1014 13:41:19.242533 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-rsyslog-d7l26"] Oct 14 13:41:19.250829 master-0 kubenswrapper[4807]: I1014 13:41:19.250372 4807 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 14 13:41:19.965211 master-0 kubenswrapper[4807]: I1014 13:41:19.965045 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-rsyslog-d7l26" event={"ID":"3002395e-511a-4ab7-b04f-259785cbaebf","Type":"ContainerStarted","Data":"86faa5b4e1ac1f90033ed166f6b8d2a1f789e6855d4288cbd2022c2c4f28b942"} Oct 14 13:41:28.085768 master-0 kubenswrapper[4807]: I1014 13:41:28.085702 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-rsyslog-d7l26" event={"ID":"3002395e-511a-4ab7-b04f-259785cbaebf","Type":"ContainerStarted","Data":"1367f5fb84f02e517fd27ea54a3e48e3e6e55afd40b1a7ac0a3adb27401c83f4"} Oct 14 13:41:29.098706 master-0 kubenswrapper[4807]: I1014 13:41:29.098546 4807 generic.go:334] "Generic (PLEG): container finished" podID="3002395e-511a-4ab7-b04f-259785cbaebf" containerID="1367f5fb84f02e517fd27ea54a3e48e3e6e55afd40b1a7ac0a3adb27401c83f4" exitCode=0 Oct 14 13:41:29.098706 master-0 kubenswrapper[4807]: I1014 13:41:29.098611 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-rsyslog-d7l26" event={"ID":"3002395e-511a-4ab7-b04f-259785cbaebf","Type":"ContainerDied","Data":"1367f5fb84f02e517fd27ea54a3e48e3e6e55afd40b1a7ac0a3adb27401c83f4"} Oct 14 13:41:31.132168 master-0 kubenswrapper[4807]: I1014 13:41:31.132056 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-rsyslog-d7l26" event={"ID":"3002395e-511a-4ab7-b04f-259785cbaebf","Type":"ContainerStarted","Data":"ecfd96d760d04c29a2be155777b2775dcb930cfe36dfd59bd614562853c7077e"} Oct 14 13:41:31.132900 master-0 kubenswrapper[4807]: I1014 13:41:31.132307 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:41:31.167312 master-0 kubenswrapper[4807]: I1014 13:41:31.167136 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/octavia-rsyslog-d7l26" podStartSLOduration=2.420187424 podStartE2EDuration="13.167093759s" podCreationTimestamp="2025-10-14 13:41:18 +0000 UTC" firstStartedPulling="2025-10-14 13:41:19.25033063 +0000 UTC m=+1273.931632454" lastFinishedPulling="2025-10-14 13:41:29.997236965 +0000 UTC m=+1284.678538789" observedRunningTime="2025-10-14 13:41:31.157105593 +0000 UTC m=+1285.838407437" watchObservedRunningTime="2025-10-14 13:41:31.167093759 +0000 UTC m=+1285.848395613" Oct 14 13:41:48.510231 master-0 kubenswrapper[4807]: I1014 13:41:48.510149 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/octavia-rsyslog-d7l26" Oct 14 13:42:13.802611 master-0 kubenswrapper[4807]: I1014 13:42:13.802537 4807 scope.go:117] "RemoveContainer" containerID="154e045c44b233e12ac1b09369f24ce2b30cb6442f6e9d8fb99bfc713cd0b3fe" Oct 14 13:42:23.966490 master-0 kubenswrapper[4807]: I1014 13:42:23.965074 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/octavia-healthmanager-lnnhq"] Oct 14 13:42:23.975083 master-0 kubenswrapper[4807]: I1014 13:42:23.973373 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:23.983561 master-0 kubenswrapper[4807]: I1014 13:42:23.983439 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-certs-secret" Oct 14 13:42:23.983742 master-0 kubenswrapper[4807]: I1014 13:42:23.983592 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-healthmanager-scripts" Oct 14 13:42:23.983853 master-0 kubenswrapper[4807]: I1014 13:42:23.983797 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-healthmanager-config-data" Oct 14 13:42:23.985442 master-0 kubenswrapper[4807]: I1014 13:42:23.985240 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-healthmanager-lnnhq"] Oct 14 13:42:24.149301 master-0 kubenswrapper[4807]: I1014 13:42:24.149215 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data-merged\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.149301 master-0 kubenswrapper[4807]: I1014 13:42:24.149282 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.149301 master-0 kubenswrapper[4807]: I1014 13:42:24.149312 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/9fa6f1d3-fc08-4584-afae-91c66edaca59-hm-ports\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.149659 master-0 kubenswrapper[4807]: I1014 13:42:24.149346 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-amphora-certs\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.149659 master-0 kubenswrapper[4807]: I1014 13:42:24.149598 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-scripts\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.149819 master-0 kubenswrapper[4807]: I1014 13:42:24.149776 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-combined-ca-bundle\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253232 master-0 kubenswrapper[4807]: I1014 13:42:24.253032 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data-merged\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253232 master-0 kubenswrapper[4807]: I1014 13:42:24.253173 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253481 master-0 kubenswrapper[4807]: I1014 13:42:24.253234 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/9fa6f1d3-fc08-4584-afae-91c66edaca59-hm-ports\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253481 master-0 kubenswrapper[4807]: I1014 13:42:24.253326 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-amphora-certs\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253481 master-0 kubenswrapper[4807]: I1014 13:42:24.253376 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-scripts\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.253699 master-0 kubenswrapper[4807]: I1014 13:42:24.253448 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-combined-ca-bundle\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.254023 master-0 kubenswrapper[4807]: I1014 13:42:24.253966 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data-merged\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.255130 master-0 kubenswrapper[4807]: I1014 13:42:24.255071 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/9fa6f1d3-fc08-4584-afae-91c66edaca59-hm-ports\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.258646 master-0 kubenswrapper[4807]: I1014 13:42:24.257898 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-config-data\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.258646 master-0 kubenswrapper[4807]: I1014 13:42:24.258088 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-combined-ca-bundle\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.258932 master-0 kubenswrapper[4807]: I1014 13:42:24.258737 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-scripts\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.259281 master-0 kubenswrapper[4807]: I1014 13:42:24.259242 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/9fa6f1d3-fc08-4584-afae-91c66edaca59-amphora-certs\") pod \"octavia-healthmanager-lnnhq\" (UID: \"9fa6f1d3-fc08-4584-afae-91c66edaca59\") " pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.308633 master-0 kubenswrapper[4807]: I1014 13:42:24.308531 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:24.869019 master-0 kubenswrapper[4807]: I1014 13:42:24.868970 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-healthmanager-lnnhq"] Oct 14 13:42:25.661162 master-0 kubenswrapper[4807]: I1014 13:42:25.661086 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-healthmanager-lnnhq" event={"ID":"9fa6f1d3-fc08-4584-afae-91c66edaca59","Type":"ContainerStarted","Data":"6cb23d7f5b094c9f1ef2eb4e375714b3b1b435f7c2fa7cc82f4f9ae50295e9d0"} Oct 14 13:42:25.661162 master-0 kubenswrapper[4807]: I1014 13:42:25.661141 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-healthmanager-lnnhq" event={"ID":"9fa6f1d3-fc08-4584-afae-91c66edaca59","Type":"ContainerStarted","Data":"67eb8062248ddb5ffd07bec9f95611214adf9519501d257fdd2f0357bc81444d"} Oct 14 13:42:25.728020 master-0 kubenswrapper[4807]: I1014 13:42:25.727819 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/octavia-housekeeping-s89gt"] Oct 14 13:42:25.763302 master-0 kubenswrapper[4807]: I1014 13:42:25.730218 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.768697 master-0 kubenswrapper[4807]: I1014 13:42:25.768643 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-housekeeping-scripts" Oct 14 13:42:25.772508 master-0 kubenswrapper[4807]: I1014 13:42:25.772429 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-housekeeping-config-data" Oct 14 13:42:25.782593 master-0 kubenswrapper[4807]: I1014 13:42:25.782561 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-housekeeping-s89gt"] Oct 14 13:42:25.921604 master-0 kubenswrapper[4807]: I1014 13:42:25.921534 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-combined-ca-bundle\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.921604 master-0 kubenswrapper[4807]: I1014 13:42:25.921598 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.921604 master-0 kubenswrapper[4807]: I1014 13:42:25.921631 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-hm-ports\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.922162 master-0 kubenswrapper[4807]: I1014 13:42:25.921659 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-scripts\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.922162 master-0 kubenswrapper[4807]: I1014 13:42:25.921691 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-amphora-certs\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:25.922162 master-0 kubenswrapper[4807]: I1014 13:42:25.921715 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data-merged\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024156 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-combined-ca-bundle\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024235 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024269 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-hm-ports\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024295 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-scripts\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024327 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-amphora-certs\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024355 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data-merged\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.025555 master-0 kubenswrapper[4807]: I1014 13:42:26.024972 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data-merged\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.028273 master-0 kubenswrapper[4807]: I1014 13:42:26.027633 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-hm-ports\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.028971 master-0 kubenswrapper[4807]: I1014 13:42:26.028916 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-combined-ca-bundle\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.030647 master-0 kubenswrapper[4807]: I1014 13:42:26.030505 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-config-data\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.034829 master-0 kubenswrapper[4807]: I1014 13:42:26.034771 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-scripts\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.036420 master-0 kubenswrapper[4807]: I1014 13:42:26.036374 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/4f78068d-7b19-4442-b4ee-da4dd3aa3d8d-amphora-certs\") pod \"octavia-housekeeping-s89gt\" (UID: \"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d\") " pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.092201 master-0 kubenswrapper[4807]: I1014 13:42:26.092084 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:26.658098 master-0 kubenswrapper[4807]: I1014 13:42:26.653004 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-housekeeping-s89gt"] Oct 14 13:42:26.687332 master-0 kubenswrapper[4807]: I1014 13:42:26.687257 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-housekeeping-s89gt" event={"ID":"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d","Type":"ContainerStarted","Data":"1249c94fbcd4cd15f2fa3ebe05ab3602a804303e78be5b0cf0e149bf0e69dce9"} Oct 14 13:42:26.959593 master-0 kubenswrapper[4807]: I1014 13:42:26.959531 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openstack/octavia-worker-vz4d9"] Oct 14 13:42:26.961100 master-0 kubenswrapper[4807]: I1014 13:42:26.961069 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:26.964712 master-0 kubenswrapper[4807]: I1014 13:42:26.964671 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-worker-scripts" Oct 14 13:42:26.964929 master-0 kubenswrapper[4807]: I1014 13:42:26.964672 4807 reflector.go:368] Caches populated for *v1.Secret from object-"openstack"/"octavia-worker-config-data" Oct 14 13:42:26.968995 master-0 kubenswrapper[4807]: I1014 13:42:26.968932 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-worker-vz4d9"] Oct 14 13:42:27.147018 master-0 kubenswrapper[4807]: I1014 13:42:27.146906 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-combined-ca-bundle\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.147018 master-0 kubenswrapper[4807]: I1014 13:42:27.147030 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.147355 master-0 kubenswrapper[4807]: I1014 13:42:27.147099 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data-merged\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.147355 master-0 kubenswrapper[4807]: I1014 13:42:27.147167 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-hm-ports\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.147355 master-0 kubenswrapper[4807]: I1014 13:42:27.147310 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-amphora-certs\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.147518 master-0 kubenswrapper[4807]: I1014 13:42:27.147424 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-scripts\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250198 master-0 kubenswrapper[4807]: I1014 13:42:27.250026 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-hm-ports\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250427 master-0 kubenswrapper[4807]: I1014 13:42:27.250196 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-amphora-certs\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250427 master-0 kubenswrapper[4807]: I1014 13:42:27.250316 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-scripts\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250427 master-0 kubenswrapper[4807]: I1014 13:42:27.250371 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-combined-ca-bundle\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250650 master-0 kubenswrapper[4807]: I1014 13:42:27.250429 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.250650 master-0 kubenswrapper[4807]: I1014 13:42:27.250536 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data-merged\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.251660 master-0 kubenswrapper[4807]: I1014 13:42:27.251566 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data-merged\" (UniqueName: \"kubernetes.io/empty-dir/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data-merged\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.257812 master-0 kubenswrapper[4807]: I1014 13:42:27.257764 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"hm-ports\" (UniqueName: \"kubernetes.io/configmap/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-hm-ports\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.261173 master-0 kubenswrapper[4807]: I1014 13:42:27.260617 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"combined-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-combined-ca-bundle\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.261173 master-0 kubenswrapper[4807]: I1014 13:42:27.260983 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"config-data\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-config-data\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.261579 master-0 kubenswrapper[4807]: I1014 13:42:27.261102 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"amphora-certs\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-amphora-certs\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.263278 master-0 kubenswrapper[4807]: I1014 13:42:27.263250 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"scripts\" (UniqueName: \"kubernetes.io/secret/cd262f9b-e205-44da-9b0f-d8fbfd82c2fa-scripts\") pod \"octavia-worker-vz4d9\" (UID: \"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa\") " pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.327909 master-0 kubenswrapper[4807]: I1014 13:42:27.325584 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:27.697928 master-0 kubenswrapper[4807]: I1014 13:42:27.697864 4807 generic.go:334] "Generic (PLEG): container finished" podID="9fa6f1d3-fc08-4584-afae-91c66edaca59" containerID="6cb23d7f5b094c9f1ef2eb4e375714b3b1b435f7c2fa7cc82f4f9ae50295e9d0" exitCode=0 Oct 14 13:42:27.697928 master-0 kubenswrapper[4807]: I1014 13:42:27.697925 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-healthmanager-lnnhq" event={"ID":"9fa6f1d3-fc08-4584-afae-91c66edaca59","Type":"ContainerDied","Data":"6cb23d7f5b094c9f1ef2eb4e375714b3b1b435f7c2fa7cc82f4f9ae50295e9d0"} Oct 14 13:42:28.712479 master-0 kubenswrapper[4807]: I1014 13:42:28.712300 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-housekeeping-s89gt" event={"ID":"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d","Type":"ContainerStarted","Data":"fb6717e7d2b7f37776f56f60ffa56852a7eb19d20a3e37b25c48b1acb973c621"} Oct 14 13:42:28.717134 master-0 kubenswrapper[4807]: I1014 13:42:28.717084 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-healthmanager-lnnhq" event={"ID":"9fa6f1d3-fc08-4584-afae-91c66edaca59","Type":"ContainerStarted","Data":"fef9cd3d141ee0550f3c615755f1fed536f6b6d5f6fb7f8a01bc162c5a27877d"} Oct 14 13:42:28.718019 master-0 kubenswrapper[4807]: I1014 13:42:28.717981 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:28.792363 master-0 kubenswrapper[4807]: W1014 13:42:28.789520 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcd262f9b_e205_44da_9b0f_d8fbfd82c2fa.slice/crio-51c14e652e78b7ec2e181f448ad83420026dfbf2ffa22de581c86e414e1abefc WatchSource:0}: Error finding container 51c14e652e78b7ec2e181f448ad83420026dfbf2ffa22de581c86e414e1abefc: Status 404 returned error can't find the container with id 51c14e652e78b7ec2e181f448ad83420026dfbf2ffa22de581c86e414e1abefc Oct 14 13:42:28.807224 master-0 kubenswrapper[4807]: I1014 13:42:28.807133 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openstack/octavia-worker-vz4d9"] Oct 14 13:42:28.820968 master-0 kubenswrapper[4807]: I1014 13:42:28.820838 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/octavia-healthmanager-lnnhq" podStartSLOduration=5.820808675 podStartE2EDuration="5.820808675s" podCreationTimestamp="2025-10-14 13:42:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 13:42:28.779558766 +0000 UTC m=+1343.460860590" watchObservedRunningTime="2025-10-14 13:42:28.820808675 +0000 UTC m=+1343.502110499" Oct 14 13:42:29.730903 master-0 kubenswrapper[4807]: I1014 13:42:29.730831 4807 generic.go:334] "Generic (PLEG): container finished" podID="4f78068d-7b19-4442-b4ee-da4dd3aa3d8d" containerID="fb6717e7d2b7f37776f56f60ffa56852a7eb19d20a3e37b25c48b1acb973c621" exitCode=0 Oct 14 13:42:29.731513 master-0 kubenswrapper[4807]: I1014 13:42:29.730974 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-housekeeping-s89gt" event={"ID":"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d","Type":"ContainerDied","Data":"fb6717e7d2b7f37776f56f60ffa56852a7eb19d20a3e37b25c48b1acb973c621"} Oct 14 13:42:29.738138 master-0 kubenswrapper[4807]: I1014 13:42:29.738077 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-worker-vz4d9" event={"ID":"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa","Type":"ContainerStarted","Data":"51c14e652e78b7ec2e181f448ad83420026dfbf2ffa22de581c86e414e1abefc"} Oct 14 13:42:30.757361 master-0 kubenswrapper[4807]: I1014 13:42:30.757193 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-housekeeping-s89gt" event={"ID":"4f78068d-7b19-4442-b4ee-da4dd3aa3d8d","Type":"ContainerStarted","Data":"5abc6e0e1e53b73d1a709e5663cd6c99effbca229944f429c6ff57345707e2ce"} Oct 14 13:42:30.759014 master-0 kubenswrapper[4807]: I1014 13:42:30.758981 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:30.788294 master-0 kubenswrapper[4807]: I1014 13:42:30.788196 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/octavia-housekeeping-s89gt" podStartSLOduration=4.322956802 podStartE2EDuration="5.788174436s" podCreationTimestamp="2025-10-14 13:42:25 +0000 UTC" firstStartedPulling="2025-10-14 13:42:26.658940401 +0000 UTC m=+1341.340242225" lastFinishedPulling="2025-10-14 13:42:28.124158035 +0000 UTC m=+1342.805459859" observedRunningTime="2025-10-14 13:42:30.784557943 +0000 UTC m=+1345.465859757" watchObservedRunningTime="2025-10-14 13:42:30.788174436 +0000 UTC m=+1345.469476260" Oct 14 13:42:31.772174 master-0 kubenswrapper[4807]: I1014 13:42:31.772099 4807 generic.go:334] "Generic (PLEG): container finished" podID="cd262f9b-e205-44da-9b0f-d8fbfd82c2fa" containerID="7c9e9ab22df4cf715acf7bc8af20a644da176a90048a04e9c6bd7ab9e671a78a" exitCode=0 Oct 14 13:42:31.773077 master-0 kubenswrapper[4807]: I1014 13:42:31.772281 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-worker-vz4d9" event={"ID":"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa","Type":"ContainerDied","Data":"7c9e9ab22df4cf715acf7bc8af20a644da176a90048a04e9c6bd7ab9e671a78a"} Oct 14 13:42:32.786960 master-0 kubenswrapper[4807]: I1014 13:42:32.786916 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openstack/octavia-worker-vz4d9" event={"ID":"cd262f9b-e205-44da-9b0f-d8fbfd82c2fa","Type":"ContainerStarted","Data":"ab46e2d14120bfebeaf3c00ee9306b1eeee9746d6f44d35d80ad5c882a31a88f"} Oct 14 13:42:32.787561 master-0 kubenswrapper[4807]: I1014 13:42:32.787544 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openstack/octavia-worker-vz4d9" Oct 14 13:42:39.342254 master-0 kubenswrapper[4807]: I1014 13:42:39.342131 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/octavia-healthmanager-lnnhq" Oct 14 13:42:39.377519 master-0 kubenswrapper[4807]: I1014 13:42:39.375362 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openstack/octavia-worker-vz4d9" podStartSLOduration=11.721306954 podStartE2EDuration="13.375340213s" podCreationTimestamp="2025-10-14 13:42:26 +0000 UTC" firstStartedPulling="2025-10-14 13:42:28.796740747 +0000 UTC m=+1343.478042561" lastFinishedPulling="2025-10-14 13:42:30.450773996 +0000 UTC m=+1345.132075820" observedRunningTime="2025-10-14 13:42:32.809665746 +0000 UTC m=+1347.490967570" watchObservedRunningTime="2025-10-14 13:42:39.375340213 +0000 UTC m=+1354.056642037" Oct 14 13:42:41.135075 master-0 kubenswrapper[4807]: I1014 13:42:41.134957 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/octavia-housekeeping-s89gt" Oct 14 13:42:42.365150 master-0 kubenswrapper[4807]: I1014 13:42:42.365077 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openstack/octavia-worker-vz4d9" Oct 14 13:43:13.872415 master-0 kubenswrapper[4807]: I1014 13:43:13.872308 4807 scope.go:117] "RemoveContainer" containerID="6e418b73d060961770a350f72e6d44e1045e18b545ecc5ba3992d4fe66905dd5" Oct 14 13:43:13.898196 master-0 kubenswrapper[4807]: I1014 13:43:13.898139 4807 scope.go:117] "RemoveContainer" containerID="df7f6028af8790c422ee8e7baaefb5491dc3a276d851e36ed83dc79101845432" Oct 14 13:45:19.071914 master-0 kubenswrapper[4807]: I1014 13:45:19.071825 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-db-create-k8c9r"] Oct 14 13:45:19.085647 master-0 kubenswrapper[4807]: I1014 13:45:19.085425 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-db-create-k8c9r"] Oct 14 13:45:20.274248 master-0 kubenswrapper[4807]: I1014 13:45:20.274155 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24f7d4f6-6841-4767-9319-872ca9839498" path="/var/lib/kubelet/pods/24f7d4f6-6841-4767-9319-872ca9839498/volumes" Oct 14 13:45:21.043868 master-0 kubenswrapper[4807]: I1014 13:45:21.043800 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-db-create-md9ws"] Oct 14 13:45:21.056410 master-0 kubenswrapper[4807]: I1014 13:45:21.056346 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-db-create-md9ws"] Oct 14 13:45:21.072752 master-0 kubenswrapper[4807]: I1014 13:45:21.072668 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-db-create-mvgwz"] Oct 14 13:45:21.087947 master-0 kubenswrapper[4807]: I1014 13:45:21.087528 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-db-create-mvgwz"] Oct 14 13:45:22.276136 master-0 kubenswrapper[4807]: I1014 13:45:22.276047 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e741407-a04b-4ac8-aee7-16c7106b1922" path="/var/lib/kubelet/pods/2e741407-a04b-4ac8-aee7-16c7106b1922/volumes" Oct 14 13:45:22.276820 master-0 kubenswrapper[4807]: I1014 13:45:22.276806 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a796f380-0a4b-490f-a260-e65b306cfd6a" path="/var/lib/kubelet/pods/a796f380-0a4b-490f-a260-e65b306cfd6a/volumes" Oct 14 13:45:31.066698 master-0 kubenswrapper[4807]: I1014 13:45:31.066543 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/keystone-7e6f-account-create-ln8x7"] Oct 14 13:45:31.077068 master-0 kubenswrapper[4807]: I1014 13:45:31.076987 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/keystone-7e6f-account-create-ln8x7"] Oct 14 13:45:32.052960 master-0 kubenswrapper[4807]: I1014 13:45:32.052854 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/barbican-db-create-6mbbn"] Oct 14 13:45:32.064665 master-0 kubenswrapper[4807]: I1014 13:45:32.064445 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/placement-fe87-account-create-6crd5"] Oct 14 13:45:32.090281 master-0 kubenswrapper[4807]: I1014 13:45:32.090196 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/barbican-db-create-6mbbn"] Oct 14 13:45:32.099621 master-0 kubenswrapper[4807]: I1014 13:45:32.099539 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/placement-fe87-account-create-6crd5"] Oct 14 13:45:32.280895 master-0 kubenswrapper[4807]: I1014 13:45:32.280753 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a38fc97-3de1-43a0-af06-748de7eea473" path="/var/lib/kubelet/pods/3a38fc97-3de1-43a0-af06-748de7eea473/volumes" Oct 14 13:45:32.281943 master-0 kubenswrapper[4807]: I1014 13:45:32.281895 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9" path="/var/lib/kubelet/pods/4fa2a4c1-49a4-4681-ac8a-ed89d64c53d9/volumes" Oct 14 13:45:32.282964 master-0 kubenswrapper[4807]: I1014 13:45:32.282919 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f774784d-e9d4-4293-b9f7-3ce1260f1d19" path="/var/lib/kubelet/pods/f774784d-e9d4-4293-b9f7-3ce1260f1d19/volumes" Oct 14 13:45:35.090971 master-0 kubenswrapper[4807]: I1014 13:45:35.090829 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-db-create-lgjbp"] Oct 14 13:45:35.127041 master-0 kubenswrapper[4807]: I1014 13:45:35.126735 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-db-create-kg5d4"] Oct 14 13:45:35.138921 master-0 kubenswrapper[4807]: I1014 13:45:35.138859 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-db-create-lgjbp"] Oct 14 13:45:35.145272 master-0 kubenswrapper[4807]: I1014 13:45:35.145188 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/heat-db-create-kg5d4"] Oct 14 13:45:36.281676 master-0 kubenswrapper[4807]: I1014 13:45:36.281586 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22319933-9e06-424f-89ad-2c1c9cf12e21" path="/var/lib/kubelet/pods/22319933-9e06-424f-89ad-2c1c9cf12e21/volumes" Oct 14 13:45:36.282749 master-0 kubenswrapper[4807]: I1014 13:45:36.282708 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6d368a6-4114-443f-a3d0-0cb58c2fc860" path="/var/lib/kubelet/pods/b6d368a6-4114-443f-a3d0-0cb58c2fc860/volumes" Oct 14 13:45:42.054851 master-0 kubenswrapper[4807]: I1014 13:45:42.054719 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/glance-d6bb-account-create-cmbxg"] Oct 14 13:45:42.062688 master-0 kubenswrapper[4807]: I1014 13:45:42.062548 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/glance-d6bb-account-create-cmbxg"] Oct 14 13:45:42.275091 master-0 kubenswrapper[4807]: I1014 13:45:42.275002 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e9b1f09-655a-4d72-9f24-7067135e6de0" path="/var/lib/kubelet/pods/9e9b1f09-655a-4d72-9f24-7067135e6de0/volumes" Oct 14 13:45:43.057416 master-0 kubenswrapper[4807]: I1014 13:45:43.057356 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/heat-9d01-account-create-q4lw2"] Oct 14 13:45:43.064253 master-0 kubenswrapper[4807]: I1014 13:45:43.064157 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/barbican-6fa4-account-create-gtm96"] Oct 14 13:45:43.070565 master-0 kubenswrapper[4807]: I1014 13:45:43.070421 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/barbican-6fa4-account-create-gtm96"] Oct 14 13:45:43.076710 master-0 kubenswrapper[4807]: I1014 13:45:43.076662 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/heat-9d01-account-create-q4lw2"] Oct 14 13:45:44.062861 master-0 kubenswrapper[4807]: I1014 13:45:44.062764 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/neutron-e815-account-create-k9rrg"] Oct 14 13:45:44.072386 master-0 kubenswrapper[4807]: I1014 13:45:44.072300 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/neutron-e815-account-create-k9rrg"] Oct 14 13:45:44.273247 master-0 kubenswrapper[4807]: I1014 13:45:44.273172 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1122c4c0-d1a1-4b65-8e30-09a7ab543979" path="/var/lib/kubelet/pods/1122c4c0-d1a1-4b65-8e30-09a7ab543979/volumes" Oct 14 13:45:44.273785 master-0 kubenswrapper[4807]: I1014 13:45:44.273750 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13e302d5-d89f-4a34-a041-eee10e251d24" path="/var/lib/kubelet/pods/13e302d5-d89f-4a34-a041-eee10e251d24/volumes" Oct 14 13:45:44.274254 master-0 kubenswrapper[4807]: I1014 13:45:44.274216 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe7bfab3-b4c5-4f22-b86c-d237c3edf145" path="/var/lib/kubelet/pods/fe7bfab3-b4c5-4f22-b86c-d237c3edf145/volumes" Oct 14 13:45:53.049787 master-0 kubenswrapper[4807]: I1014 13:45:53.049719 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/cinder-27b4-account-create-8hj4v"] Oct 14 13:45:53.058338 master-0 kubenswrapper[4807]: I1014 13:45:53.058285 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/cinder-27b4-account-create-8hj4v"] Oct 14 13:45:54.274074 master-0 kubenswrapper[4807]: I1014 13:45:54.273973 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc3d596-0e58-4527-ae07-c7e7abf57426" path="/var/lib/kubelet/pods/ecc3d596-0e58-4527-ae07-c7e7abf57426/volumes" Oct 14 13:45:55.047481 master-0 kubenswrapper[4807]: I1014 13:45:55.047353 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-db-create-t64s7"] Oct 14 13:45:55.061400 master-0 kubenswrapper[4807]: I1014 13:45:55.061327 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-db-create-t64s7"] Oct 14 13:45:56.274374 master-0 kubenswrapper[4807]: I1014 13:45:56.274284 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06503d41-6114-4621-9118-71f452042e07" path="/var/lib/kubelet/pods/06503d41-6114-4621-9118-71f452042e07/volumes" Oct 14 13:46:05.054231 master-0 kubenswrapper[4807]: I1014 13:46:05.054131 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/ironic-c7da-account-create-rnsqw"] Oct 14 13:46:05.067827 master-0 kubenswrapper[4807]: I1014 13:46:05.067650 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/ironic-c7da-account-create-rnsqw"] Oct 14 13:46:06.273664 master-0 kubenswrapper[4807]: I1014 13:46:06.273610 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5b1db5-657d-413a-aeee-5e085a79ea7e" path="/var/lib/kubelet/pods/7b5b1db5-657d-413a-aeee-5e085a79ea7e/volumes" Oct 14 13:46:14.010485 master-0 kubenswrapper[4807]: I1014 13:46:14.007091 4807 scope.go:117] "RemoveContainer" containerID="5d91cad0267ed1d36ca2b7776d42f3059a9b068dc4fa9e739f1ca396647d7e6d" Oct 14 13:46:14.125985 master-0 kubenswrapper[4807]: I1014 13:46:14.125928 4807 scope.go:117] "RemoveContainer" containerID="5dc2d7111f48307491cb740d79dac5ab26b772ebb8129d417a2b316d94bc40a4" Oct 14 13:46:14.145549 master-0 kubenswrapper[4807]: I1014 13:46:14.145491 4807 scope.go:117] "RemoveContainer" containerID="6d5b02055b7eb1642db99602c894b3a4a55fdc4b27b78bb4f4949cfe75570f11" Oct 14 13:46:14.180280 master-0 kubenswrapper[4807]: I1014 13:46:14.180222 4807 scope.go:117] "RemoveContainer" containerID="843b898a552f800a5ca6f35b22d9e2b0d28fa70caf8132d25998368a2a17e015" Oct 14 13:46:14.211351 master-0 kubenswrapper[4807]: I1014 13:46:14.211305 4807 scope.go:117] "RemoveContainer" containerID="8f768448c6681b11cce06c92a27a2d5ba4b5c67da02179c60062a27c219b7582" Oct 14 13:46:14.247796 master-0 kubenswrapper[4807]: I1014 13:46:14.247655 4807 scope.go:117] "RemoveContainer" containerID="be206c55f79e147d0db49ff0691c1e94ca42a5b9ecf3f597dc37dad8d97959d2" Oct 14 13:46:14.289374 master-0 kubenswrapper[4807]: I1014 13:46:14.289321 4807 scope.go:117] "RemoveContainer" containerID="b72be291260aecd5713d1a0256d2f6e2701cb5aa756f367c436736dc4ef35fb6" Oct 14 13:46:14.311857 master-0 kubenswrapper[4807]: I1014 13:46:14.311803 4807 scope.go:117] "RemoveContainer" containerID="028830a30badaddb3aa15a6214663d208297d9e369903e1ef4799c2989c99f4f" Oct 14 13:46:14.332174 master-0 kubenswrapper[4807]: I1014 13:46:14.332137 4807 scope.go:117] "RemoveContainer" containerID="1f2a94ad409ded9f97935644a655870ee0fa7b975225ddbad6fd0f18dc570c15" Oct 14 13:46:14.352017 master-0 kubenswrapper[4807]: I1014 13:46:14.351942 4807 scope.go:117] "RemoveContainer" containerID="075a59d57c58142d65ec1f85ecea3e8e9cf3c87de2c09b43c4a605f75a29b725" Oct 14 13:46:14.379821 master-0 kubenswrapper[4807]: I1014 13:46:14.379753 4807 scope.go:117] "RemoveContainer" containerID="4076ef786e84915bcc38b61a8e249077657b5424387ac2f1910c2dc17cd9a886" Oct 14 13:46:14.402118 master-0 kubenswrapper[4807]: I1014 13:46:14.402044 4807 scope.go:117] "RemoveContainer" containerID="19b5d872c486fd813ccd1358e31b1acec5668a2eb10c5ed345b9428f18054512" Oct 14 13:46:14.421050 master-0 kubenswrapper[4807]: I1014 13:46:14.421005 4807 scope.go:117] "RemoveContainer" containerID="803901bffef2b227e43d7d3535cc175414c3e83fd726c4d70b58c0412a2cc026" Oct 14 13:46:14.438865 master-0 kubenswrapper[4807]: I1014 13:46:14.438809 4807 scope.go:117] "RemoveContainer" containerID="d16d22aed023d43936da07c839658f96c83d935663bd17377bbdbe505ce03033" Oct 14 13:46:14.461784 master-0 kubenswrapper[4807]: I1014 13:46:14.461715 4807 scope.go:117] "RemoveContainer" containerID="f1760f5110c645bd3718bfe24d4e94d056a876c2a8dba56dc1dabe3f689e2a81" Oct 14 13:47:21.061026 master-0 kubenswrapper[4807]: I1014 13:47:21.060945 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-api-db-create-4clwc"] Oct 14 13:47:21.076078 master-0 kubenswrapper[4807]: I1014 13:47:21.076023 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-api-db-create-4clwc"] Oct 14 13:47:22.280127 master-0 kubenswrapper[4807]: I1014 13:47:22.280016 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8909ed0-31ec-436e-a543-d16ba5247cff" path="/var/lib/kubelet/pods/d8909ed0-31ec-436e-a543-d16ba5247cff/volumes" Oct 14 13:47:23.045584 master-0 kubenswrapper[4807]: I1014 13:47:23.045482 4807 kubelet.go:2437] "SyncLoop DELETE" source="api" pods=["openstack/nova-cell0-db-create-sjlfx"] Oct 14 13:47:23.050166 master-0 kubenswrapper[4807]: I1014 13:47:23.050068 4807 kubelet.go:2431] "SyncLoop REMOVE" source="api" pods=["openstack/nova-cell0-db-create-sjlfx"] Oct 14 13:47:24.278302 master-0 kubenswrapper[4807]: I1014 13:47:24.278174 4807 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c116711-616c-466d-89a2-0992401c40fa" path="/var/lib/kubelet/pods/9c116711-616c-466d-89a2-0992401c40fa/volumes" Oct 14 13:48:14.723070 master-0 kubenswrapper[4807]: I1014 13:48:14.722952 4807 scope.go:117] "RemoveContainer" containerID="27d26353591f9565f1ce4af139c457333d27a4789858be9255609e3d21bace8d" Oct 14 13:48:14.765797 master-0 kubenswrapper[4807]: I1014 13:48:14.765712 4807 scope.go:117] "RemoveContainer" containerID="073f21ef3c1b8e612442b3256183d8912a9cc074e4a7d53d12fc30c0dac4a738" Oct 14 14:04:20.840531 master-0 kubenswrapper[4807]: I1014 14:04:20.840382 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-68d546b9d8-9strj_f78dc348-fb2b-469f-8401-e2f66a301e22/controller/0.log" Oct 14 14:04:20.853020 master-0 kubenswrapper[4807]: I1014 14:04:20.852970 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-68d546b9d8-9strj_f78dc348-fb2b-469f-8401-e2f66a301e22/kube-rbac-proxy/0.log" Oct 14 14:04:20.865893 master-0 kubenswrapper[4807]: I1014 14:04:20.865851 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-handler-sbvf7_33ef96a1-d23e-4f7f-979c-b6c333a56b3d/nmstate-handler/0.log" Oct 14 14:04:20.886059 master-0 kubenswrapper[4807]: I1014 14:04:20.886000 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-j4j8c_86673331-76cf-4fb6-82f1-9b29dd02b918/nmstate-metrics/0.log" Oct 14 14:04:20.904434 master-0 kubenswrapper[4807]: I1014 14:04:20.904384 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-metrics-fdff9cb8d-j4j8c_86673331-76cf-4fb6-82f1-9b29dd02b918/kube-rbac-proxy/0.log" Oct 14 14:04:20.936794 master-0 kubenswrapper[4807]: I1014 14:04:20.936762 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-operator-858ddd8f98-7gf7t_9e163479-33bf-42a3-9e83-f97d58c5fc56/nmstate-operator/0.log" Oct 14 14:04:20.969653 master-0 kubenswrapper[4807]: I1014 14:04:20.969585 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-nmstate_nmstate-webhook-6cdbc54649-bj7wk_56544611-e79a-4a8b-ab46-239048f85bc3/nmstate-webhook/0.log" Oct 14 14:04:23.125419 master-0 kubenswrapper[4807]: I1014 14:04:23.125351 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-guard-master-0_1dce93eb-a125-476a-8f6b-c704747457f6/guard/0.log" Oct 14 14:04:23.177704 master-0 kubenswrapper[4807]: I1014 14:04:23.177561 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/controller/0.log" Oct 14 14:04:23.242439 master-0 kubenswrapper[4807]: I1014 14:04:23.242389 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcdctl/0.log" Oct 14 14:04:23.616492 master-0 kubenswrapper[4807]: I1014 14:04:23.616407 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd/0.log" Oct 14 14:04:23.643293 master-0 kubenswrapper[4807]: I1014 14:04:23.643192 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-metrics/0.log" Oct 14 14:04:23.675786 master-0 kubenswrapper[4807]: I1014 14:04:23.675596 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-readyz/0.log" Oct 14 14:04:23.702146 master-0 kubenswrapper[4807]: I1014 14:04:23.702074 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-rev/0.log" Oct 14 14:04:23.729918 master-0 kubenswrapper[4807]: I1014 14:04:23.729880 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/setup/0.log" Oct 14 14:04:23.757537 master-0 kubenswrapper[4807]: I1014 14:04:23.757486 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-ensure-env-vars/0.log" Oct 14 14:04:23.784307 master-0 kubenswrapper[4807]: I1014 14:04:23.784230 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-resources-copy/0.log" Oct 14 14:04:24.164415 master-0 kubenswrapper[4807]: I1014 14:04:24.164338 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/frr/0.log" Oct 14 14:04:24.205827 master-0 kubenswrapper[4807]: I1014 14:04:24.205774 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/reloader/0.log" Oct 14 14:04:24.226034 master-0 kubenswrapper[4807]: I1014 14:04:24.225978 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/frr-metrics/0.log" Oct 14 14:04:24.255649 master-0 kubenswrapper[4807]: I1014 14:04:24.255581 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/kube-rbac-proxy/0.log" Oct 14 14:04:24.283764 master-0 kubenswrapper[4807]: I1014 14:04:24.283614 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-authentication_oauth-openshift-65687bc9c8-w9j4s_c7fda5b1-b0b4-4499-98c4-db254f06d4bf/oauth-openshift/0.log" Oct 14 14:04:24.287941 master-0 kubenswrapper[4807]: I1014 14:04:24.287903 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/kube-rbac-proxy-frr/0.log" Oct 14 14:04:24.304558 master-0 kubenswrapper[4807]: I1014 14:04:24.304281 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-frr-files/0.log" Oct 14 14:04:24.322160 master-0 kubenswrapper[4807]: I1014 14:04:24.322091 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-reloader/0.log" Oct 14 14:04:24.341139 master-0 kubenswrapper[4807]: I1014 14:04:24.341074 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-metrics/0.log" Oct 14 14:04:24.383445 master-0 kubenswrapper[4807]: I1014 14:04:24.381372 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-64bf5d555-sgx9c_6c5ab050-caa4-4372-871f-45bc7f28ad18/frr-k8s-webhook-server/0.log" Oct 14 14:04:24.408413 master-0 kubenswrapper[4807]: I1014 14:04:24.408350 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6479dd8558-s545w_08bcb56b-d815-4c79-947b-587268bc009f/manager/0.log" Oct 14 14:04:24.427262 master-0 kubenswrapper[4807]: I1014 14:04:24.427168 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-6d98fdfb58-5gp8d_b04933b1-7908-4c4d-be70-59b27ed5b313/webhook-server/0.log" Oct 14 14:04:24.857080 master-0 kubenswrapper[4807]: I1014 14:04:24.857010 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-10-master-0_eb3f687c-2994-4dc5-8070-f641e02b4341/installer/0.log" Oct 14 14:04:25.037309 master-0 kubenswrapper[4807]: I1014 14:04:25.036974 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-8-master-0_51884012-8236-469c-8c63-49c36027fe7e/installer/0.log" Oct 14 14:04:25.061581 master-0 kubenswrapper[4807]: I1014 14:04:25.061493 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_revision-pruner-10-master-0_6a3af738-a42f-44ab-92b7-9f941ef04832/pruner/0.log" Oct 14 14:04:25.402023 master-0 kubenswrapper[4807]: I1014 14:04:25.401950 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn"] Oct 14 14:04:25.403051 master-0 kubenswrapper[4807]: I1014 14:04:25.403013 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.406798 master-0 kubenswrapper[4807]: I1014 14:04:25.406750 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-zqxwl"/"openshift-service-ca.crt" Oct 14 14:04:25.407410 master-0 kubenswrapper[4807]: I1014 14:04:25.407337 4807 reflector.go:368] Caches populated for *v1.ConfigMap from object-"openshift-must-gather-zqxwl"/"kube-root-ca.crt" Oct 14 14:04:25.422905 master-0 kubenswrapper[4807]: I1014 14:04:25.422847 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn"] Oct 14 14:04:25.481689 master-0 kubenswrapper[4807]: I1014 14:04:25.481615 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkx52\" (UniqueName: \"kubernetes.io/projected/0b795b9e-d164-4e87-90ce-221ca555d0b9-kube-api-access-zkx52\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.482176 master-0 kubenswrapper[4807]: I1014 14:04:25.481752 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-podres\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.482176 master-0 kubenswrapper[4807]: I1014 14:04:25.481797 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-proc\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.482176 master-0 kubenswrapper[4807]: I1014 14:04:25.481835 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-lib-modules\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.482176 master-0 kubenswrapper[4807]: I1014 14:04:25.481875 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-sys\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.518255 master-0 kubenswrapper[4807]: I1014 14:04:25.518159 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-hfvls_aabbab44-056d-4d23-a56c-877219e1a31f/speaker/0.log" Oct 14 14:04:25.526956 master-0 kubenswrapper[4807]: I1014 14:04:25.526905 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_speaker-hfvls_aabbab44-056d-4d23-a56c-877219e1a31f/kube-rbac-proxy/0.log" Oct 14 14:04:25.570440 master-0 kubenswrapper[4807]: I1014 14:04:25.570285 4807 kubelet.go:2421] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zqxwl/master-0-debug-cq87n"] Oct 14 14:04:25.574216 master-0 kubenswrapper[4807]: I1014 14:04:25.574176 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585124 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-proc\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585213 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-lib-modules\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585259 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-sys\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585341 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-zkx52\" (UniqueName: \"kubernetes.io/projected/0b795b9e-d164-4e87-90ce-221ca555d0b9-kube-api-access-zkx52\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585410 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-podres\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585674 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-podres\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585741 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-proc\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585825 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-lib-modules\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.587021 master-0 kubenswrapper[4807]: I1014 14:04:25.585863 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b795b9e-d164-4e87-90ce-221ca555d0b9-sys\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.622487 master-0 kubenswrapper[4807]: I1014 14:04:25.614225 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkx52\" (UniqueName: \"kubernetes.io/projected/0b795b9e-d164-4e87-90ce-221ca555d0b9-kube-api-access-zkx52\") pod \"perf-node-gather-daemonset-bnjsn\" (UID: \"0b795b9e-d164-4e87-90ce-221ca555d0b9\") " pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.687421 master-0 kubenswrapper[4807]: I1014 14:04:25.687346 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7d2ms\" (UniqueName: \"kubernetes.io/projected/45a348fd-7ea8-4c13-bddb-597764ee336e-kube-api-access-7d2ms\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.687677 master-0 kubenswrapper[4807]: I1014 14:04:25.687444 4807 reconciler_common.go:245] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a348fd-7ea8-4c13-bddb-597764ee336e-host\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.726195 master-0 kubenswrapper[4807]: I1014 14:04:25.726118 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:25.793568 master-0 kubenswrapper[4807]: I1014 14:04:25.790035 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a348fd-7ea8-4c13-bddb-597764ee336e-host\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.793568 master-0 kubenswrapper[4807]: I1014 14:04:25.790235 4807 reconciler_common.go:218] "operationExecutor.MountVolume started for volume \"kube-api-access-7d2ms\" (UniqueName: \"kubernetes.io/projected/45a348fd-7ea8-4c13-bddb-597764ee336e-kube-api-access-7d2ms\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.793568 master-0 kubenswrapper[4807]: I1014 14:04:25.790568 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/45a348fd-7ea8-4c13-bddb-597764ee336e-host\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.815558 master-0 kubenswrapper[4807]: I1014 14:04:25.811742 4807 operation_generator.go:637] "MountVolume.SetUp succeeded for volume \"kube-api-access-7d2ms\" (UniqueName: \"kubernetes.io/projected/45a348fd-7ea8-4c13-bddb-597764ee336e-kube-api-access-7d2ms\") pod \"master-0-debug-cq87n\" (UID: \"45a348fd-7ea8-4c13-bddb-597764ee336e\") " pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.896021 master-0 kubenswrapper[4807]: I1014 14:04:25.895950 4807 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" Oct 14 14:04:25.935476 master-0 kubenswrapper[4807]: I1014 14:04:25.932849 4807 provider.go:102] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Oct 14 14:04:26.189691 master-0 kubenswrapper[4807]: I1014 14:04:26.189604 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" event={"ID":"45a348fd-7ea8-4c13-bddb-597764ee336e","Type":"ContainerStarted","Data":"b0f4bc18d038235fffc18b5d66fb5befc951db516c031f8273efb6866a34a8eb"} Oct 14 14:04:26.381393 master-0 kubenswrapper[4807]: I1014 14:04:26.381324 4807 kubelet.go:2428] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn"] Oct 14 14:04:26.389521 master-0 kubenswrapper[4807]: W1014 14:04:26.389438 4807 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0b795b9e_d164_4e87_90ce_221ca555d0b9.slice/crio-962a230b130397a3bc4193f2894805bcd34d1c48bd4361202c1fbb8245a2bc29 WatchSource:0}: Error finding container 962a230b130397a3bc4193f2894805bcd34d1c48bd4361202c1fbb8245a2bc29: Status 404 returned error can't find the container with id 962a230b130397a3bc4193f2894805bcd34d1c48bd4361202c1fbb8245a2bc29 Oct 14 14:04:27.209310 master-0 kubenswrapper[4807]: I1014 14:04:27.209243 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" event={"ID":"0b795b9e-d164-4e87-90ce-221ca555d0b9","Type":"ContainerStarted","Data":"cbace1d8dd78d6531c641c948826cf9d773316f4530d7e3fb7668315345b87ff"} Oct 14 14:04:27.209310 master-0 kubenswrapper[4807]: I1014 14:04:27.209302 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" event={"ID":"0b795b9e-d164-4e87-90ce-221ca555d0b9","Type":"ContainerStarted","Data":"962a230b130397a3bc4193f2894805bcd34d1c48bd4361202c1fbb8245a2bc29"} Oct 14 14:04:27.209990 master-0 kubenswrapper[4807]: I1014 14:04:27.209544 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:27.233903 master-0 kubenswrapper[4807]: I1014 14:04:27.233822 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" podStartSLOduration=2.233805465 podStartE2EDuration="2.233805465s" podCreationTimestamp="2025-10-14 14:04:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2025-10-14 14:04:27.231974656 +0000 UTC m=+2661.913276480" watchObservedRunningTime="2025-10-14 14:04:27.233805465 +0000 UTC m=+2661.915107289" Oct 14 14:04:27.802801 master-0 kubenswrapper[4807]: I1014 14:04:27.802449 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7b6784d654-27mg2_b3275d9d-1998-47e4-b6bf-73bba3222f41/oauth-apiserver/0.log" Oct 14 14:04:27.823105 master-0 kubenswrapper[4807]: I1014 14:04:27.823060 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-oauth-apiserver_apiserver-7b6784d654-27mg2_b3275d9d-1998-47e4-b6bf-73bba3222f41/fix-audit-permissions/0.log" Oct 14 14:04:35.290296 master-0 kubenswrapper[4807]: I1014 14:04:35.290095 4807 kubelet.go:2453] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" event={"ID":"45a348fd-7ea8-4c13-bddb-597764ee336e","Type":"ContainerStarted","Data":"a9c07bbd8ad9aff60ddfea2a8a1c589c19d3e8d296f1520c73198b8bb91578ce"} Oct 14 14:04:35.754524 master-0 kubenswrapper[4807]: I1014 14:04:35.754362 4807 kubelet.go:2542] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zqxwl/perf-node-gather-daemonset-bnjsn" Oct 14 14:04:36.505349 master-0 kubenswrapper[4807]: I1014 14:04:36.505119 4807 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-zqxwl/master-0-debug-cq87n" podStartSLOduration=2.850578251 podStartE2EDuration="11.505099015s" podCreationTimestamp="2025-10-14 14:04:25 +0000 UTC" firstStartedPulling="2025-10-14 14:04:25.932758669 +0000 UTC m=+2660.614060493" lastFinishedPulling="2025-10-14 14:04:34.587279433 +0000 UTC m=+2669.268581257" observedRunningTime="2025-10-14 14:04:35.972670124 +0000 UTC m=+2670.653971948" watchObservedRunningTime="2025-10-14 14:04:36.505099015 +0000 UTC m=+2671.186400839" Oct 14 14:04:38.394236 master-0 kubenswrapper[4807]: I1014 14:04:38.394193 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5958979c8-mpc88_2cda9578-9f83-4956-8b1f-cb63d831f051/console/0.log" Oct 14 14:04:41.015905 master-0 kubenswrapper[4807]: I1014 14:04:41.015854 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qp6p_07a860df-b531-4eb6-a7a8-4f34c08b4c53/dns/0.log" Oct 14 14:04:41.132016 master-0 kubenswrapper[4807]: I1014 14:04:41.131939 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6qp6p_07a860df-b531-4eb6-a7a8-4f34c08b4c53/kube-rbac-proxy/0.log" Oct 14 14:04:41.297426 master-0 kubenswrapper[4807]: I1014 14:04:41.297261 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-544bd_8b7e285d-eb25-409b-9d12-ad9cb384768e/dns-node-resolver/0.log" Oct 14 14:04:42.850553 master-0 kubenswrapper[4807]: I1014 14:04:42.850498 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-guard-master-0_1dce93eb-a125-476a-8f6b-c704747457f6/guard/0.log" Oct 14 14:04:42.953748 master-0 kubenswrapper[4807]: I1014 14:04:42.953662 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcdctl/0.log" Oct 14 14:04:43.323511 master-0 kubenswrapper[4807]: I1014 14:04:43.323267 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd/0.log" Oct 14 14:04:43.365112 master-0 kubenswrapper[4807]: I1014 14:04:43.365038 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-metrics/0.log" Oct 14 14:04:43.391571 master-0 kubenswrapper[4807]: I1014 14:04:43.391525 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-readyz/0.log" Oct 14 14:04:43.411675 master-0 kubenswrapper[4807]: I1014 14:04:43.411609 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-rev/0.log" Oct 14 14:04:43.430677 master-0 kubenswrapper[4807]: I1014 14:04:43.430620 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/setup/0.log" Oct 14 14:04:43.451239 master-0 kubenswrapper[4807]: I1014 14:04:43.451182 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-ensure-env-vars/0.log" Oct 14 14:04:43.476917 master-0 kubenswrapper[4807]: I1014 14:04:43.476844 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_etcd-master-0_14286286be88b59efc7cfc15eca1cc38/etcd-resources-copy/0.log" Oct 14 14:04:44.355161 master-0 kubenswrapper[4807]: I1014 14:04:44.355094 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-10-master-0_eb3f687c-2994-4dc5-8070-f641e02b4341/installer/0.log" Oct 14 14:04:44.500961 master-0 kubenswrapper[4807]: I1014 14:04:44.500922 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_installer-8-master-0_51884012-8236-469c-8c63-49c36027fe7e/installer/0.log" Oct 14 14:04:44.524943 master-0 kubenswrapper[4807]: I1014 14:04:44.524893 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-etcd_revision-pruner-10-master-0_6a3af738-a42f-44ab-92b7-9f941ef04832/pruner/0.log" Oct 14 14:04:46.376738 master-0 kubenswrapper[4807]: I1014 14:04:46.376685 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4wx2z_c593965b-ba7b-477c-b906-0c57232dc126/node-ca/0.log" Oct 14 14:04:48.080985 master-0 kubenswrapper[4807]: I1014 14:04:48.080910 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fkqvb_c5db64cb-0ab9-4fd2-a09e-9070aa2976e4/serve-healthcheck-canary/0.log" Oct 14 14:04:53.008418 master-0 kubenswrapper[4807]: I1014 14:04:53.008234 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/alertmanager/0.log" Oct 14 14:04:53.037751 master-0 kubenswrapper[4807]: I1014 14:04:53.037694 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/config-reloader/0.log" Oct 14 14:04:53.099753 master-0 kubenswrapper[4807]: I1014 14:04:53.099638 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/kube-rbac-proxy-web/0.log" Oct 14 14:04:53.118050 master-0 kubenswrapper[4807]: I1014 14:04:53.117983 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/kube-rbac-proxy/0.log" Oct 14 14:04:53.151335 master-0 kubenswrapper[4807]: I1014 14:04:53.151253 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/kube-rbac-proxy-metric/0.log" Oct 14 14:04:53.174896 master-0 kubenswrapper[4807]: I1014 14:04:53.174834 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/prom-label-proxy/0.log" Oct 14 14:04:53.203523 master-0 kubenswrapper[4807]: I1014 14:04:53.203344 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-1_6055814d-fb43-4d86-9e50-5127255b5aa4/init-config-reloader/0.log" Oct 14 14:04:53.429249 master-0 kubenswrapper[4807]: I1014 14:04:53.429182 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-76c4979bdc-mgff4_7d0db662-28b6-4bb1-9e26-87a39fc0344d/metrics-server/0.log" Oct 14 14:04:53.518687 master-0 kubenswrapper[4807]: I1014 14:04:53.518620 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gww4z_a24a8ebe-d871-438b-b267-24dd4b994ce6/node-exporter/0.log" Oct 14 14:04:53.541198 master-0 kubenswrapper[4807]: I1014 14:04:53.541132 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gww4z_a24a8ebe-d871-438b-b267-24dd4b994ce6/kube-rbac-proxy/0.log" Oct 14 14:04:53.564837 master-0 kubenswrapper[4807]: I1014 14:04:53.564811 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gww4z_a24a8ebe-d871-438b-b267-24dd4b994ce6/init-textfile/0.log" Oct 14 14:04:55.585617 master-0 kubenswrapper[4807]: I1014 14:04:55.585539 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/prometheus/0.log" Oct 14 14:04:55.614578 master-0 kubenswrapper[4807]: I1014 14:04:55.614454 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/config-reloader/0.log" Oct 14 14:04:55.641001 master-0 kubenswrapper[4807]: I1014 14:04:55.640934 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/thanos-sidecar/0.log" Oct 14 14:04:55.758113 master-0 kubenswrapper[4807]: I1014 14:04:55.757990 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/kube-rbac-proxy-web/0.log" Oct 14 14:04:55.779411 master-0 kubenswrapper[4807]: I1014 14:04:55.779372 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/kube-rbac-proxy/0.log" Oct 14 14:04:55.811338 master-0 kubenswrapper[4807]: I1014 14:04:55.811291 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/kube-rbac-proxy-thanos/0.log" Oct 14 14:04:55.833758 master-0 kubenswrapper[4807]: I1014 14:04:55.833736 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-1_939066aa-c4ea-48bf-97f8-5e2928c224f4/init-config-reloader/0.log" Oct 14 14:04:58.578191 master-0 kubenswrapper[4807]: I1014 14:04:58.578102 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-68d546b9d8-9strj_f78dc348-fb2b-469f-8401-e2f66a301e22/controller/0.log" Oct 14 14:04:58.597858 master-0 kubenswrapper[4807]: I1014 14:04:58.597806 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_controller-68d546b9d8-9strj_f78dc348-fb2b-469f-8401-e2f66a301e22/kube-rbac-proxy/0.log" Oct 14 14:05:01.510689 master-0 kubenswrapper[4807]: I1014 14:05:01.510615 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/controller/0.log" Oct 14 14:05:02.448651 master-0 kubenswrapper[4807]: I1014 14:05:02.448532 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/frr/0.log" Oct 14 14:05:02.474218 master-0 kubenswrapper[4807]: I1014 14:05:02.474146 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/reloader/0.log" Oct 14 14:05:02.501795 master-0 kubenswrapper[4807]: I1014 14:05:02.501719 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/frr-metrics/0.log" Oct 14 14:05:02.573366 master-0 kubenswrapper[4807]: I1014 14:05:02.573308 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/kube-rbac-proxy/0.log" Oct 14 14:05:02.599985 master-0 kubenswrapper[4807]: I1014 14:05:02.599912 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/kube-rbac-proxy-frr/0.log" Oct 14 14:05:02.624884 master-0 kubenswrapper[4807]: I1014 14:05:02.624826 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-frr-files/0.log" Oct 14 14:05:02.650894 master-0 kubenswrapper[4807]: I1014 14:05:02.650845 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-reloader/0.log" Oct 14 14:05:02.680226 master-0 kubenswrapper[4807]: I1014 14:05:02.680177 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-qqrwm_37d82bf0-fc72-4e94-9f3b-73cd32e876ad/cp-metrics/0.log" Oct 14 14:05:02.711696 master-0 kubenswrapper[4807]: I1014 14:05:02.711543 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_frr-k8s-webhook-server-64bf5d555-sgx9c_6c5ab050-caa4-4372-871f-45bc7f28ad18/frr-k8s-webhook-server/0.log" Oct 14 14:05:02.779187 master-0 kubenswrapper[4807]: I1014 14:05:02.779116 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-controller-manager-6479dd8558-s545w_08bcb56b-d815-4c79-947b-587268bc009f/manager/0.log" Oct 14 14:05:02.807611 master-0 kubenswrapper[4807]: I1014 14:05:02.807533 4807 log.go:25] "Finished parsing log file" path="/var/log/pods/metallb-system_metallb-operator-webhook-server-6d98fdfb58-5gp8d_b04933b1-7908-4c4d-be70-59b27ed5b313/webhook-server/0.log"